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PREFACE 


How to use most effectively the information yielded by general 
intelligence tests is one of the most important questions before the 
educational world at the present time. Many of our leading educa- 
tional thinkers are urging that the children in our elementary schools 
be grouped into grades on the basis of their mental ages and divided 
into sections within the grade on the basis of intelligence quotients. 
Other educators maintain that this should not be done. In this 
monograph Dr. C. W. Odell presents the results of an investigation 
extending over nearly twoyears in which he has studied with unusual 
carecertain of the questions involved in the proposal that we reor- 
ganize our schools on the basis of the results yielded by general 
intelligence tests. Because the questions studied are highly impor- 
tant it is felt that a somewhat detailed report is justified. In order 
to assist the reader in understanding the experiment the organization 
of the experimental schools has been described in detail. 

This investigation was undertaken at the invitation of Superin- 
tendent Peter A. Mortenson of Chicago. Its execution was made 
possible by the cooperation of Assistant Superintendent A. B. Wight 
and of certain principals and teachers in the Chicago public schools. 
To all who have cooperated in the course of the investigation the 
Bureau of Educational Research desires to acknowledge its indebt- 


edness. 
Watter S. Monroe, Director. 


November 10, 1922. 
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THE USE OF INTELLIGENCE TESTS AS A BASIS OF 
SCHOOL ORGANIZATION AND INSTRUCTION 


CHAPTER I 
THE PLAN AND CONDUCT OF THE EXPERIMENT 


The Problem. The experiment described in this bulletin was 
carried on in eight elementary schools in the city of Chicago. It 
was an attempt to answer the following question: What is the effect 
upon the efficiency of elementary schools of promoting and classify- 
ing pupils chiefly upon their mental ages and intelligence quotients 
as determined by group intelligence tests rather than according to 
the traditional method? It is recognized that this is really a double 
problem involving the question of a flexible system of promotion 
and classification upon any basis as compared with a non-flexible 
system, and also the question of using the results of group intelligence 
tests rather than some other basis for promotion and classification. 
The justification for combining these two questions is that the use 
of the results from group intelligence tests for the purposes men- 
tioned above necessarily involves a flexible system and hence the 
two questions may be considered as one from the standpoint of 
practical school administration. 

Definition of terms used in statement of problem. The 
“efficiency” of a school is the ratio of its output to the investment, or 
mens The output or return upon the investment is measured 
in terms of the achievements of the pupils and their rates of progress 
through the school system. The investment, as the term is used 
above, includes not only what might strictly be called investment 
but also the factors which affect the manner in which the investment 
proper is used. The “promoting” of pupils refers to their advance- 
ment from one half-grade to another. The “classifying” of pupils 
refers to their placement in the fast, average and slow sections into 
which each half-grade in the experimental schools was divided. 
The word “chiefly” is used in the statement of the problem because 
the information derived from group intelligence tests was supple- 
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mented by other data. The “traditional method” refers to the 
method of placement used in the group of control schools. Accord- 
ing to this method, promotion is determined by the pupil’s final 
mark, which is usually a composite of the mark that he receives 
upon the final examination and that given by the teacher for his 
work during the term. In some cases the promotion indicated by 
the pupil’s final mark is modified by the principal’s opinion of his 
work or ability or by such considerations as chronological age, 
length of time already spent in the grade, number of pupils in the 
room, etc. This is the method which has been and still is the pre- 
vailing practice in the elementary schools of this country. 


Scope of study. This study was confined to elementary 
schools having sixteen’ or more teachers, which were organized in six- 
teen half-grades and in which pupils were promoted semi-annually. 
These schools were divided into an experimental and a control 
group of four each by Assistant Superintendent A. B. Wight. In 
making this selection, Mr. Wight endeavored to choose two groups 
of schools? in which the investment factors should be approximately 
equal at the beginning of the experiment.* Except in the plan of 
organization of the experimental schools, nothing was done to cause 
any change. 

This investigation was rather strictly limited to the study of 
the effect upon the “efficiency” of certain elementary schools of pro- 
moting and classifying pupils chiefly according to the data derived 
from the use of group tests of intelligence. There was no consid- 
eration of the desirability of discovering and segregating for in- 
structional purposes pupils of varying degrees of ability, except 
from the standpoint of their rates of progress and achievements in 
school. Neither was there any assumption that the plan used, 
which provided that pupils of different degrees of ability should 
complete the same course of study at different rates of progress, 


1In one of the control schools there were only fourteen teachers in charge of 
pupils who actually participated in the project. 

2The experimental schools were the Armour, Franklin, Holden and Moseley. In 
the control group were the Alcott, Greene, Mark Sheridan and Webster. 

3A more complete comparison of the investment factors in the two groups of 
schools may be found in the dissertation of the same title and by the same writer as 
this bulletin. This dissertation is on file in the library of the University of Illinois. 
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was superior to a plan providing that the different groups of pupils 
should cover different courses of study. 

In this experiment the measurement of the achievements of 
the pupils was, with certain minor exceptions, limited to arithmetic 
and reading. As these are two of the most fundamental subjects 
studied in the elementary school, they were considered a fairly 
good measure of total achievement. 

The general plan of the experiment. The experiment be- 
gan in the autumn of 1920 and continued until the summer of 1922. 
As Table I shows, both intelligence and subject-matter tests were 
administered to the pupils of both groups of schools once each 
semester except that at the last testing only subject-matter tests 
were used. Also certain other data that seemed pertinent to the 
investigation were collected at each time of testing. After the first 
testing period the pupils of the experimental schools were promoted 
and classified upon the basis of the test results and the other data 
which had been obtained. After each of the later testing periods 
such adjustments were made as seemed advisable. No direct use 
was made of the test results or other data in the control schools. 
There was some opportunity for the teachers of this group of 
schools to make a more or less indirect use of the test results but 
they did not do so to a degree sufficient to affect the results of the 
experiment. By thus measuring the abilities and achievements of 
the pupils of the two groups of schools near the beginning and end 
of each semester the resulting data afforded a basis for comparing 
the effect of promoting and classifying pupils chiefly upon the re- 
sults obtained from the use of group tests of intelligence with that 
of promoting pupils according to the traditional method. 

The first tests were given in November, 1920, and the results 
used in promoting and classifying the pupils for the second semes- 
ter of 1920-21. The next testing occurred in May, 1921, and fur- 
nished the basis for the placement of the pupils for the following 
September. All new entrants were tested in September and assigned 
to their grades and sections as soon thereafter as possible. A gen- 
eral testing occurred again in December and was followed by the 
placement of the pupils for the second semester of 1921-22. The 
final testing was in May, 1922. In addition to these general testing 
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periods, small groups of absentees and new entrants were tested 
from time to time as seemed best. 

The tests were in all cases given by the regular teachers who 
had been prepared for this work by a careful program of meetings 
with discussion. The teachers were also given very detailed direc- 
tions. Rather extensive visiting by the writer while the tests were 
being administered showed that this program of preparation secured 
fairly uniform and correct procedure, Part of the scoring of the 
tests was done by the teachers and part by clerks in Assistant 
Superintendent Wight’s office. The scoring was also checked suffi- 
ciently by the writer to warrant the belief that it was fairly accurate. 
Most of the errors which were found were so small that they had 
no effect upon the placement of pupils. In the tabulation of test 
and other data the positive and negative errors balanced each other 
so as to leave no sensible inaccuracy in the medians and other 
measures computed. 


The data collected. Table I shows the intelligence and 
achievement tests used at each date of testing. The scores made 
upon these tests were translated into mental* or achievement ages, 
as the case might be, and then further into intelligence® and achieve- 
ment’ quotients. The mental ages and intelligence quotients used 


4Mental age is a term used to express the amount of intelligence possessed by an 
individual. The average score made upon an intelligence test by a large number of 
unselected children of any one given chronological age is said to be equal to amental 
age of the given number of years. Thus, if on a given test the average score of six- 
year-olds is 25 points and that of seven-year-olds is 30 points, a score of 25 points may 
be transmuted into a mental age of six years and one of 30 points into one of seven 
years. It is abbreviated M.A. 

5Achievement age is used to express the amount achieved by an individual on 
a subject-matter test. The average score made by the children of a single mental age 
is taken to equal an achievement age of the same number of years. Thus, if the aver- 
age score of children of the mental age of ten years is 56 points, that score may be 
changed into an achievement age—abbreviated A.A.—of ten years. 

The intelligence quotient is the ratio of the mental age to the chronological age, 
or M.A. divided by C.A. Itis conventionally carried to two places and written without 
the decimal point. Thus a child who has a mental age of ten years and is eight years 
old has an intelligence quotient of 10 divided by 8, or 125. It is abbreviated I.Q. 

7The achievement quotient—abbreviated A.Q.—is the ratio of the achievement 
age to the mental age, or A.A. divided by M.A. It is written similarly to the I.Q. 
Thus a child whose achievement age is nine years and whose mental age is ten years 
has an achievement quotient of 9 divided by 10, or 90. 
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TABLEI. THE INTELLIGENCE AND ACHIEVEMENT TESTS USED 
IN THIS EXPERIMENT 


Date 
of Grades 
Testing 
Nov. | IB-IIIB 
1920 
IB-IIIB 
IIIA-VITIA 
IIIA-VIIIA 
May IB-ITIB 
1921 
IITA-VIIIA 
Sept. | IB 
1921 
IA-IIIB 
TIIA-VIIIA 
Dec. IB-IIIB 
1921 
TITA-VHIA 
May 
1922 
4*See Appendix C, 


Intelligence 
Tests 


Indiana University Primer Scale 
(Pressey Primer) 


Dearborn Group Tests of In- 
telligence 


National Intelligence Tests, 
Scale A, Form I 


Illinois General Intelligence 


Scale, Form I 


Indiana University Primer Scale 


Illinois General 
Scale, Form II 


Intelligence 


Kingsbury Primary Group In- 
telligence Scale, Form A 


Indiana University PrimerScale 


Illinois General 
Scale, Form II 


Intelligence 


Myers Mental Measure 


Illinois General 
Scale, Form I 


Intelligence 


None used. 


IIB-ITIB 


IITA-VIB 
VIA-VIIIA 


IITA-VIB 
VIA-VITIA 


Achievement 
Tests 


Indiana University First Grade 


Reading Vocabulary Test, 
Form A 


Indiana University Scale of At- 
tainment No. 1, Form A 


Monroe’s Standardized Silent 
Reading Tests 
Form I, Test 1 
Form I, Test 2 


Monroe’s General Survey Scale 
in Arithmetic 
Form I, Scale 1 
Form I, Scale 2 


The same tests were used as in 
November, 1920, except that 
Form B of the two Indiana 
Tests and Form II of the 
Monroe Tests were used. 


The same tests were used as in 
May, 1921 


The same tests were used as in 
November, 1920, except that 
Form III of the Monroe Tests 


was used. 


The same tests were used as in 
November, 1920, except that 
Form B of the Indiana Vo- 
cabulary Test and Revised 
Form A of the Scale of At- 
tainment No. 1 were used. 


VIB-VIIIA | Omnibus Test* 


at the first time of testing were based upon the average of the two 
mental tests given at that time. 

The other items of information called for by the individual 
record cards used in this project were as follows: name, building, 
date of birth, sex, date of testing, school grade, chronological age, 
teacher’s estimate, average school mark, attendance, and health mark. 

The teacher’s estimate was an opinion as to the general capacity 
of the pupil regardless of whether this capacity was actually dis- 
played in regular school work or not. This estimate was expressed 
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in terms of the following five marks and the teachers were instructed 
to make their distributions accord fairly closely with that given 
below: 

S or 5=superior— 5 to 10 percent 

E or 4—excellent— 20 percent 

G or 3=good —40 to 50 percent 

F or 2=fair — 20 percent 

P or 1=poor — 5 to 10 percent 

The average school mark was the average of the pupil’s marks 
upon the seven most important subjects of the course of study. It 
was based upon the grades on the monthly reports issued during 
the current semester previous to the date of testing and was 
expressed in terms of the same five marks that were used for the 
teachers’ estimates. 

Attendance was given as the percent of school days from the 
beginning of the semester to the date of testing during which the 
pupil was present. The health mark was the teacher’s opinion of 
the general health of the pupil and was expressed in terms of the 
same five marks that were used for teachers’ estimates and average 
school marks. 

At the time of the first testing, the published norms and data 
for the transmutation of point scores upon the tests used into mental 
and achievement ages were in most cases based on a number of 
pupils not much larger, or even actually smaller, than the number 
taking the tests in this experiment. Hence it was decided that in 
the case of most of the tests used, the norms and tables for trans- 
mutation should be based upon the data obtained in this project.® 
The exceptions to this decision were the Illinois Examination, includ- 
ing the Illinois General Intelligence Scale and Monroe’s Arithmetic 
and Reading Tests, and the Myers Mental Measure. These ex- 
ceptions were made because in the case of the Illinois Examination 
scores from about fifty thousand pupils were available,® and in 
that of the Myers Mental Measure scores from about fifteen 
thousand pupils.?° 


8See complete dissertation for these transmutation tables and their derivation. 

*Monroe, W. S. A Report of the Use of the Illinois Examination, Form 1, with 
49,500 Pupils. Insert of School and Home Education, March, 1921. 8p. 

Myers, C. E. and G. C. Measuring Minds. New York; Newson, 1921, p. 
23-4, 
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Principles of promotion and classification used at the first 
placement of the pupils. It was necessary to lay down certain 
principles which should be followed in the placement of the pupils, 
with the understanding that there would be need for exceptions 
in the cases of certain individuals. The inadvisability of following 
set rules too closely was due to several facts. Such procedure would 
result in entirely too great a change in the placement of some pupils. 
Moreover, the data secured from the tests and from other sources 
could not be relied upon as being absolutely accurate, and in some 
cases were so conflicting that disagreements between any detailed 
principles laid down were sure to occur. In view of these facts it 
must be understood that the principles enumerated below were not 
adhered to absolutely and that there were exceptions of many 
sorts that it is impracticable to list. The principles formulated for 
the first placement of pupils, which was for February, 1921, are 
given below. 

I, The use of the data derived from the intelligence tests. 

1. The chief bases of placement were the mental ages and 
intelligence quotients. The mental ages were used to 
determine the half-grades in which the pupils should be 
placed, and the intelligence quotients to determine the 
sections, subject to such modifications as may be given 
Vitel 4 

2. In general, the mental age norm for each half-grade was 
the median mental age of this half-grade group for the 
experimental schools. If the median mental age of a 
particular half-grade group in any one school was dis- 
tinctly above or below the median of the four schools, 
a rough average of the two medians was used. ‘This 
was done because it was considered desirable to make 
some progress toward reducing the range of ability 
within a given half-grade group for the experimental 
schools, but not to do so without regard to the ability 
actually found in the half-grades of the several schools 
as they were at the beginning of the experiment. Rather 
wide mental age limits were used for each half-grade 
group, with the expectation that as the experiment pro- 
gressed they would be narrowed. 
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3. In general, demotion was recommended only when a pupil’s 
mental age was at least two years below the median of 
the grade in which he was found, and extra promotion 
only when it was at least several months higher than the 
median of the grade in which extra promotion would 
place him. In no case was a pupil recommended for 
skipping more than two semesters’ work nor for being 
demoted more than one. 


4. Pupils whose intelligence quotients were above 110 were 
usually placed in the fast sections, those with I. Q.’s be- 
low 85 in the slow sections and the remainder’ regularly 
composed the average sections. However, in many cases 
pupils’ mental ages were several months above the 
medians of the half-grades in which normal promotion 
would place them, while their I. Q.’s were below 85. In 
such cases they were usually given normal promotion to 
the average section of the next half-grade. Similar ex- 
ceptions were made in connection with other ranges of 
mental ages and intelligence quotients. 

5. In some cases where the mental ages and intelligence quo- 
tients were rather low, it appeared probable that the 
pupils had either misunderstood directions upon one of 
the two intelligence tests or, had not, through some other 
cause, done themselves justice upon one of them. In | 
such cases their scores on the other test were given more 
than half weight in determining their placement. 


II. The use of the other data obtained. 


1. Most of the other items recorded upon the individual 
record cards were given consideration. Low teachers’ 
estimates and average school marks rarely pre- 
vented promotion in cases where the mental ages seemed 
to warrant it. In doubtful cases the question of whether 


“Inasmuch as the intelligence quotients obtained in this project were derived 
from group intelligence tests they had a somewhat greater spread than those derived 
from individual tests. Therefore the percent of pupils with I.Q.’s from 85 to 110 was 


somewhat less than that usually found between 90 and 110 when individual tests are 
used. 
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a single or a double promotion should be given was, 
however, frequently decided by the teachers’ estimates 
and average school marks. 


2. On the other hand, even though their mental ages were 
low enough to merit demotion, very few pupils were 
failed whose teachers’ estimates and average school 
marks were “good” or better, and not very many were 
failed if either one of the two was this high. 


3. In making use of the teachers’ estimates of capacity 
and the average school marks it was found that those 
of some teachers ran much higher than those of others 
in cases where the mental and achievement ages \of the 
two groups of pupils showed little difference. That is, 
a teacher’s estimate or school mark of “fair,” for in- 
stance, given by one teacher might be fully equal to 
one of “good” given by another. In making use of 
these two items an allowance was made for this fact. 

4. In cases of marked disagreement between the evidence 

afforded by the test data and that given by the teachers’ 

estimates and school marks, the achievement test scores 
were frequently the deciding factor in placement. 

In doubtful cases the teachers’ estimates of health some- 

times determined placement, but were not a major 

factor. 


III. Pupils not classified. 

1. Since all promoted VIIIB and VIIIA pupils would 
leave the schools concerned before the close of the ex- 
periment, no recommendations were made in the case 
of any pupils of these grades. 

2. Pupils in open-air and ungraded rooms were recom- 
mended for promotion and classification according to 
the same principles used for the other pupils, but it was 
not expected that they would actually be placed in exact 
agreement with the recommendations. 

An illustration of the application of these principles of 
promotion and classification. In order to illustrate the actual 
application of these principles, the following sample taken from the 


Wn 
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TABLE II. SAMPLE OF THE PROMOTION LISTS MADE OUT FOR THE 
BEGINNING OF THE SECOND SEMESTER OF 1920-21 


—————————————————————————————— 


Pupil M.A. 1.Q. A.A. 4 pas * School Health Placement 


Number Mark | Mark of Pupil 
1 6.6 73 8-8 1 1.8 3 IIIA slow 
2 ah 66 7-10 2 tli 3 IVB slow 
3 113 110 10-8 4 3.8 3 VB average 
4 8.0 85 9-6 2 Dall 4 IVB fast 
5 118} 100 11-10 3 3.0 4 VB average 
6 9.1 106 9-8 3 SY 3 IVA average 
7 9.2 95 8-8 3 3.1 3 IVA average 
8 10.2 105 9-8 3 3.0 3 IVA average 
9 10.6 78 11-10 3 3.0 4 IVA slow 
10 8.8 71 10-0 2 2.0 1 IV B slow 
11 4.7 40 7-4 1 1.0 3 IIIA slow 
12 10.0 72 8-10 2 2.0 3 IVA slow 
13 1253) 109 11-6 3 3.0 3 VB fast 
14 10.4 91 11-2 3 3.0 a IVA average 
15 10.4 80 8-0 3 2.8 2 IVA slow 
16 8.7 106 9-0 2D Qe) + IVA average 
17 10.2 69 13-0 3 3.0 + VB average 
18 9.2 106 8-6 3 SW 3 IVA average 
19 8.6 85 8-4 2 1.5 1 IVB slow 
20 11.2 100 11-10 4 4.0 4 VB average 


*Teacher’s Estimate. 


lists actually made out is given and discussed. These lists were 
later submitted to the principals and teachers, as has been men- 
tioned previously, and any changes that seemed best were made. 
Since the sample in Table II is a portion of the list for the 
pupils who were in the IVB grade during the first semester of 
1920-21, the median mental and achievement ages’® for the half- 


grade groups into which IVB pupils were likely to be placed are 
given below. 


Grade IIA IVB IVA VB 
Mental Age 8.1 9.6 9.8 10.8 
Achievement Age Te veil 25) 10-6 


The mental ages of Nos. 1 and 11 were so low that it was 
evident they should be demoted. This was corroborated by the 
low teachers’ estimates and average school marks given them. Their 
I. Q.’s clearly indicated that they belonged in the slow section. 
Nos. 2, 10 and 19 had mental ages considerably below the IVB 
median and I. Q.’s of 85 or below. As their teachers’ estimates 
and school marks were also fairly low they were kept in their grade 


See Table III. 
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and placed in the slow section. No. 12 had a mental age above 
the IVB median, but an I. Q. of only 72, so he was recom- 
mended for the IVA slow section. Although No. 4’s_ mental 
age and I. Q. were low enough to indicate that he belonged 
in the IVB slow section his fairly good achievement age and his 
school mark of 2.7 resulted in his being placed in the fast section 


of that grade. This was done to prevent him from having to repeat 


work during the whole of the next semester and with the expecta- 
tion that he would soon drop back into an average or slow section. 
The mental ages of Nos. 9 and 15 seemed to entitle them to extra 
promotion but as their teachers’ estimates and school marks were 
only about average they received merely normal promotion into 
the IVA grade. Because of their low I. Q.’s they were placed in 
the slow section. In the case of the six pupils placed in the average 
section of IVA there was little doubt as to where they belonged 
except that No. 16 had a mental age almost a year below the IVA 
median. His rather high I. Q. and average school mark led to the 
decision not to prevent his advancement. Nos. 8 and 14 might have 
been considered for extra promotion had their teachers’ estimates 
and school marks been higher. Nos. 3 and 20 were clearly entitled 
to extra promotion on the basis of all the data and No. 5 was only 
slightly less deserving. The I1.Q. of the first would have caused 
his placement in the fast section but it happened there were not 
enough pupils in the school of similar ability to justify the forma- 
tion of a fast section in grade VB. Therefore all three were placed 
in the average section of that grade. No. 17 was also given extra 
promotion. In his case a chronological age of almost 16 years and 
a high score on the achievement tests were potent clauses. For the 
same reason he was placed in the average rather than the slow 
section, although his I. Q. was only 69. No. 13 would probably 
have been given two semesters of extra promotion instead of one 
except for the fact that his teacher’s estimate and school mark 
were only 3. As it was he was given one extra promotion and 
placed in the fast section of the grade. 

Supplementary principles of promotion and classification 
used at the second and third periods of placement of the 
pupils. At the second and third periods of placement—that is, 
for September, 1921, and February, 1922,—a majority of the pupils 
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placed at the beginning of the second semester of 1920-21 received 
normal promotion into the next half-grade and remained in the 
corresponding section. Unless the new data clearly indicated that 
the pupil had been placed improperly in February, 1921, this course 
was followed. Certain additional principles were adopted to care 
for those pupils who seemed to have been improperly placed. These 
principles were as follows: 


1. In the cases of a number of the pupils given extra promo- 
tion at the beginning of the previous semester, their school 
marks and achievement ages following this promotion did 
not appear to justify it. If, however, their mental ages as 
shown by the later testing were high enough to justify their 
retaining the extra promotion given and also receiving nor- 
mal promotion at the later date, such promotion was usually 
given. This was done on the assumption that after skipping 
the work of one or more semesters it might require more 
than one semester for them to “find themselves.” 


2. Pupils previously promoted or placed in fast sections despite 
their low school marks were failed if their school marks still 
continued to be unsatisfactory. 


3. Many pupils who had received only a part of the extra pro- 
motion that they seemed to deserve in February, 1921,'* 
were given further extra promotion, if their later scores justi- 


fied so doing. 


4. In cases where the test scores of pupils varied greatly from 
those made at the previous testing period or periods, and 
the other evidence did not agree with one score more than 
the other, the scores were roughly averaged to provide the 
basis for placement. 


The final placement of the pupils. The writer made out 
his recommendations for placement, basing them upon the princi- 
ples listed above, some two or three weeks before the end of the 
semester, The lists were then submitted to the principals and 
teachers concerned for their consideration, and finally put into 


Most of these seemed to be cases of laziness and lack of study. 
“These pupils had received only a part of their extra promotion in order to lessen 
the amount of work skipped at one time and thus make their advance easier. 
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effect. In two of the four schools the recommendations were dis- 
cussed individually, but in the other two this was not done, as the 
principals of those schools wished to make as complete a change 
as possible from the traditional method of procedure. The changes 
made as a result of this consideration amounted to about one per- 
cent of the total number of recommendations made. These changes 
were often due to the fact that a longer acquaintance with certain 
pupils caused the teachers to wish to revise the estimates of capacity 
or school marks which had been reported some time previously. 
Sometimes, however, the changes made represented a yielding on 
the part of the writer of his judgment, based largely upon the test 
results, to that of the principal or teacher, which was based upon 
the actual school work of the pupils and upon personal contact 
with them. In a few cases a change was made in order to place the 
pupil under a certain teacher so that he would be separated from a 
group of classmates. 

In planning this whole experiment and in formulating and using 
the principles of promotion and classification those in charge of the 
experiment were guided by the desire to do a practicable piece of 
work, That is to say, they wished to use a procedure which the 
average school administrator or supervisor would be willing and 
able to make use of in his own school. It was partly because of 
this desire that more thoroughgoing changes were not made in the 
placement of the pupils, especially after the first period of testing. 
It is true that some public school superintendents have carried out 
considerably more radical plans of reclassification than the one 
used in this experiment but it was believed that a plan that might 
be followed by a more conservative educator would be more worth 
while. 
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CHAPTER II 
CONDITIONS AT THE BEGINNING OF THE EXPERIMENT 


Chronological age-grade placement in the two groups of 
schools. The chronological age-grade situation in November, 1920, 
showed that the retardation in the experimental schools was some- 
what greater than that in the control schools. The median age of the 
pupils of the experimental schools averaged, grade for grade, two- 
tenths of a year more than that for the other group. In only two 
of the half-grades was it lower. The percents of pupils accelerated, 
normally placed, and retarded were 9, 18 and 73, respectively, in 
the experimental schools as compared with 10, 21 and 69 in the 
control schools. These figures are based upon the Chicago stand- 
ard of normal progress, which is that a pupil should be from six to 
six and one-half years of age in grade IB, six and one-half to seven 
in grade IA and so on up. The average amount of retardation 
per pupilt was 1.14 years for the experimental schools and .96 year 
for the control schools. Assuming that pupils had entered the two 
groups of schools at the same average age, which the writer believes 
was the case, it is evident that the pupils in the control schools at 
the beginning of the experiment had made somewhat more rapid 
progress than had those in the experimental schools. 


Mental age and school placement in the experimental and 
control schools. As may be seen from Table III, the median 
mental ages in all except three of the half-grades were higher in the 
control than in the experimental schools. The average difference 
was slightly over one-half year of mental age. This difference was 
found in spite of the fact just mentioned above that the pupils of 
the control schools were grade by grade about two-tenths of a year 
younger than those of the other group. 


1The average amount of retardation was computed as follows: The number of 
pupils accelerated one-half year was multiplied by one-half, the number accelerated 
one year by one, and soon. The same process was carried out for those retarded and 
the sum found for each group of pupils. As the total number of years of retard- 
ation was greater than the total of acceleration, the latter was subtracted to give the 
net total of retardation. This was divided by the total number of pupils. 
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TABLE III. GRADE MEDIAN MENTAL AND ACHIEVEMENT AGES, 
INTELLIGENCE AND ACHIEVEMENT QUOTIENTS OF THE 
EXPERIMENTAL AND CONTROL SCHOOLS, NOVEMBER, 1920 


Mental Ages Intelligence Achievement Achievement 
Grade Quotients Ages Quotients 


| | — | |S 


an oe oe 88 98 : 
: afl 100 105 Uo 7-8 97 103 
IIB Eg 8.7 95 110 6-9 W238 89 87 
IIA 8.2 9.1 92 107 35 9-0 104 102 
IIIB 9.0 8.6 100 96 10-1 S100 eats 113 
IIIA S.1~ Soe Tape 84* 7-4* TAO) lo 110* 
IVB 9.6 10.0 92 102 pal 9-0 110 102 
IVA 9.8 10.4 oP 100 a2 9-6 104 105 
VB 10.8 10.7 93 98 10-6 10-7 106 108 
VA 10.0 11.2 85 100 10-1 11-4 112 106 
VIB 11.8 11.8 97 96 10-9 11-8 100 105 
VIA 12.6 EP. 101 103 P=3 12-1 105 104 
VIIB > 14.4 99 112 11-6 13-0 105 100 
VITA 13.2 14.0 102 106 Iti || Tee 107 109 
VIIIB 14.2 14.8 104 110 12 14-4 99 109 
VIIA 15.4 15.8 111 114 1s= 7 14-7 99 105 
All veil Qi 94 103 10-0 10-8 104 103 


*The low M. A.’s and I. Q.’s found in grade IIIA were doubtless due to the fact that the 
Illinois General Intelligence Scale requires a degree of reading ability somewhat above that possessed by 
most IIIA pupils. 

**In grades IITA to VIIIA a composite achievement age was obtained by averaging the achievement 
ages upon Monroe’s arithmetic scale and in comprehension and rate upon his reading test. In obtaining 
this average each of the three was given equal weight. The same procedure was followed in the case of 
the achievement quotients. 


The inter-quartile ranges of the various grades were also com- 
puted. These showed an average range of two and one-tenth years 
for the experimental schools and two and two-tenths years for the 
control schools. Thus it appears that the grade groups in the ex- 
perimental schools were slightly more homogeneous than those in 
the control schools. Similarly, a slight advantage was shown by the 
coefficients of correlation of mental age and grade placement. These 
were .84+.01? for the experimental schools and .82-+.01 for the 
control schools. 

The intelligence quotients of the two groups of schools. 
Probably the best basis of comparing the mentality of the pupils 
of the two groups of schools is that of their intelligence quotients. 
Table III shows the medians for the two groups of schools. In all 
grades except IIIB and VIB the median I. Q.’s of the experimental 


2 For convenience all probable errors smaller than .01 are given as .O1 
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schools were lower than those of the control schools. The average 
difference was nine points, the medians for all grades combined 
being 94 and 103. This of course agrees with the fact just noted 
that the mental ages of the pupils of the experimental schools were 
lower, although their chronological ages were higher, than those of 
the other group. 

The extent to which the data derived from the tests afforded 
a true comparison of the quality of the pupil material of the two 
groups of schools depends upon the reliability of the tests used and 
the similarity of testing conditions in the two groups of schools. 
As is shown in Appendix B, the reliability of the intelligence tests 
was only fairly high, but there is no reason to think that the degree 
of reliability was different in the two groups of schools. Moreover, 
as has been stated in Chapter I, the writer’s rather extensive visiting 
while the tests were being given and his examination of the test 
booklets after they had been scored afforded fairly reliable grounds 
for believing that there were no essential differences in the admin- 
istration of the tests in the experimental and in the control schools. 


The use of the control schools as a check group upon the 
experimental schools. If we assume that the difference in the 
amount and degree of intelligence found by the use of the intelli- 
gence tests was reliable, the question remains as to whether this 
difference was so great that the control schools could not be used 
as a valid check upon the experimental schools. A definite answer 
to this question cannot be given. Such data as are available con- 
cerning the mentality of pupils of different school systems appear 
to show that an average difference of about seven months of mental 
age or nine points I. Q. is not unusual. Probably the most exten- 
sive data available upon this point are those obtained from the use 
of the Illinois General Intelligence Scale.* This scale was given to 
the pupils of ten cities and nine counties in the autumn of 1920. 
It was found that the differences between the median mental ages 
of the various grades of the single cities and counties concerned 
and the general medians for the corresponding grades were four 
months or more in 50 percent of the cases. The largest differ- 
ence was one year and three months. In terms of the I. Q. 50 


’Monroe, W. S.A Report of the Use of the Illinois Examination, Form 1, with 
49,500 Pupils. Insert of School and Home Education, March, 1921. 8p. 
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percent of the differences exceeded four points, the greatest being 
nineteen points. Differences as large as the average difference be- 
tween the two groups of schools in this experiment were found in 
about one-sixth of the cases. Moreover, it must be remembered 
that differences between the individual members of a group and 
the group median are, on the average, much less than the differences 
between the individual members of the group. On the other hand, 
the differences in this experiment were based upon the average 
scores from two tests and therefore would probably tend to be 
smaller than those based upon a single score. This latter factor 
would not more than balance the one mentioned in the previous 
sentence, however, and probably would not even do that. There- 
fore the writer feels justified in the opinion that the difference in 
mentality found to exist between the two groups of schools was 
not so great but that the question referred to above can be answered 
affirmatively, provided that this difference was measured and taken 
account of in interpreting the results of the experiment. 

The achievements of the two groups of schools. Table III 
also contains the median achievement ages for the various grades. 
It shows that the control schools were superior in all of the half- 
grades except IIIB and IVB. This average superiority was about 
eight months of achievement age, which is enough to indicate a 
decided superiority in pupil achievement on the part of the control 
schools. 

The achievement quotients, however, are really more signifi- 
cant measures than are the achievement ages. It is evident 
from Table III that on the whole the relation of achievement to 
capacity, in so far as the tests used measured this relation, was 
practically the same in the two groups of schools. This would be 
inferred from a study of the mental and achievement ages. Such a 
comparison shows that the superiority of the control schools in 
achievement was just about the same as their superiority in intelli- 
gence. Thus from this standpoint the two groups of schools were 
capitalizing the capacities of their pupils almost equally in so far 
as the achievements measured were concerned. 

The correlation of achievement with intelligence in the 
two groups of schools. It is a belief of many educators that the 
achievements of pupils should be as closely related to their capaci- 
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ties as possible and that the degree to which this relation holds is a 
measure of the success of the school in adapting its work to the 
individual pupils. The achievement quotient measures this from 
one standpoint, but it may also be measured by computing the 
correlation of achievement with intelligence. For all grades com- 
bined the coefficients of correlation between absolute achievement 
and intelligence scores was .68+.01 for the experimental schools 
and .60+.01 for the control schools. That is to say, the experi- 
mental schools were securing achievement more nearly in propor- 
tion to pupil capacity than were the control schools. 

Another measure of the relation of achievement to intelligence 
may be obtained by computing the median achievement quotients 
for pupils of different levels of intelligence. This measure is based 
upon the assumption that the school should secure from all pupils 
the best work of which they are capable, and if it can not do this 
it should approach the standard as nearly for pupils of one level of 
intelligence as for those of another. 

Table IV presents the median achievement quotients for the 
pupils of different levels of intelligence in the two groups of schools. 
A study of this table reveals the fact that in both groups of schools 
the inferior pupils were achieving more in relation to their capacity 
than were the superior pupils, but that this tendency was somewhat 


TABLE IV. MEDIAN ACHIEVEMENT QUOTIENTS OF THE PUPILS 
OF DIFFERENT LEVELS OF INTELLIGENCE, NOVEMBER, 1920 


Achievement Quotients 


Intelligence Quotient* 

Experimental] Control 

150-59 104 98 
140- 95 95 
130- 102 98 
120- 102 102 
110- 101 101 
100- 102 102 
90- 104 104 
80- 103 105 
70- 107 110 
60- 113 114 
50- 109 125 
All 105 104 


*Only those levels of intelligence were included that had a suffici . : 
feliablacmedians! ufficient number of cases to give fairly 
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less marked in the experimental schools. Further evidence to the 
same effect may be obtained from a comparison of the coefficients 
of correlation of the achievement and intelligence quotients. These 
were —.16+.01 for the experimental schools and —.28+.01 for 
the control schools. 

Teachers’ estimates of capacity, average school marks 
and estimates of health, in the two groups of schools. The 
pupil material of the two groups of schools may also be compared 
by means of the teachers’ estimates, average school marks and 
health estimates. It is true that these measures are relatively sub- 
jective, but as there were almost one hundred teachers in each 
group of schools and as there was no apparent selection which 
would make one group of teachers more able to judge pupils than 
the other, these measures were probably fairly comparable for the 
two groups of schools. Taking the medians for all pupils, the 
teachers’ estimates for the control group were two-tenths higher, 
the average school marks three-tenths higher, and the estimates of 
health two-tenths. Considering the three items together, the half- 
grade medians of the control schools were higher in about 50 
percent of the cases, those of the experimental schools in only about 
25 percent, and the two were equal in about 25 percent. The evi- 
dence afforded by these items is of value chiefly because it corrob- 
orates that obtained from the intelligence and achievement test results. 

Summary. The differences found to exist between the experi- 
mental and the control schools in November, 1920, at the beginning 
of the experiment, were on the whole large enough not to be neg- 
lected as due to chance or as of no consequence, but were not 
large enough to invalidate the use of the two groups of schools in 
this experiment. When contrasted with the control schools the 
experimental schools exhibited the following differences: 


1. .18 year greater retardation based on chronological age 
(1.14 years — .96 year) 
2. .6 year lower median mental age (9.7 years — 9.1 years) 


3. 9 points lower median I. Q. (103 — 94) 
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Del point iene achievement quotient ir 

metic (104 — 103) nal 

6. .08 higher correlation of achievement with intelli - 
(.68 — .60) ie, 

7. .2 lower median teachers’ estimate, school mark ae estat e 
of health, averaged (3.3 — 3.1) ; a 


CHAPTER Ii 


THE EFFICIENCY OF THE TWO GROUPS OF SCHOOLS AS 
MEASURED BY THE RATES OF PROGRESS 
OF THE PUPILS 


In Chapter I “efficiency” was defined as the ratio of the output 
to the investment. The output to be measured was limited to the 
achievements of the pupils and their rates of progress. As was 
stated, the various factors constituting investment were all approx- 
imately constant except that of the mental abilities of the pupil 
material. Therefore, the “efficiency” of the experimental and the 
control schools might be measured in terms of the ratios of the 
achievements of the pupils and their rates of progress to their 
mental abilities. This chapter presents the data dealing with the 
rates of progress of the pupils, and the relation of these rates to 
their mental abilities. 

The promotion and classification of the pupils for Feb- 
ruary, 1921. The information obtained from the testing in the 
four experimental schools in November, 1920, formed the chief 
basis for the placement of pupils for the succeeding semester, the 
second of 1920-21. This placement was made by the writer, fol- 
lowing the principles of promotion and classification enumerated 
in Chapter I. The first half of Table V shows the percents of pupils 
in each grade of the experimental schools gaining or losing various 
amounts as a result of this placement. It is to be interpreted as 
follows, using grade IIB as an example: 7 percent of the pupils 
in grade IIB during the first semester of 1920-21 were demoted 
one semester, that is, were placed in IA; 26 percent were 
failed and remained in IIB; 64 percent received regular 
promotion of one semester into IIA and 2 percent’ received an 
extra promotion and thus entered IIIB. It will be seen that on 
the whole the placement of the pupils in the experimental schools 
involved many more demotions and failures than extra promotions 
and that the percent of the pupils given normal promotion was not 
as great as is usual in school systems. Only 58 percent of the pupils 
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TABLE V. PERCENTS OF THE PUPILS PROMOTED, FAILED OR DE- 
MOTED THE GIVEN NUMBER OF SEMESTERS AT THE CLOSE OF 
THE FIRST SEMESTER OF 1920-21 


te ee ee ee eee ——— eee 
Se ———————————ee————— 


: Experimental Schools Control Schools 
First Semesters Gained or Lost Semesters Gained or Lost 
Semester 
Grade v|o | 41] +2| +3 || -1] 0 | 41] +2] +3} +4 
IB 48 | 49 3 1 St | 68a Ps 
IA Lee alras 9 9 34 | 60|7 
IIB FEN 260 Oe 2 2 9| 80|9 
IIA 1 193|' S708 et0 4 16" |" 83: |e 
IlIB OS 5 9 1 14] 82/4 1 
IIIA 14 | 31; 50 3 2 sya har 7a a | 
IVB Ais AG 57a ye13 8 LORS 2 ees 
IVA nla Omnos 6 Sy [heal WA EERE S 
VB AN et Gasol a4 3 Sell EMS 
VA Gael? aS 4 1 Asie Sal 
VIB HO OE Zap aS 4 11 87 | 2 
VIA 11 see fetal abd 168) 79105 
VIIB isle Ss esa eo 4| 96) 1 
VIIA Seats aS 5 18 | 78 | 4 
All Galeezonlaeos 8 2 a3) 174 79-4 503) e038: 


*—1 denotes one semester lost through demotion, O failure, +1 normal promotion, +2 one extra 
promotion, etc. 


received normal promotion, 32 percent less, and 10 percent more. 
The average amount of promotion per pupil’ was .74 semester. 
Probably the chief cause of the excess of demotions and failures 
and the low average promotion rate was the rather liberal promo- 
tion policy which had been pursued prior to the beginning of the 
project. Many decidedly inferior pupils were at the beginning of 
the experiment found to be almost up with normal pupils of the 
same chronological age, although they were unable to do satisfac- 
tory work as placed. Moreover, it had not been at all unusual to 
reward superior ability by allowing grades to be skipped. 

The second half of Table V shows the changes made in the 
placement of the pupils in the control schools at this time. These 
changes were made by the teachers and principals according to the 
usual practice, which in Chapter I was called the “traditional 
method.” A much larger percent of the pupils received normal 
promotion than in the experimental schools, but only about one- 


'The average amount of promotion per pupil was computed by finding the total 
number of semesters of promotion given, subtracting therefrom the total number of 
semesters of demotion and dividing by the total number of pupils concerned. 
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half as many were demoted or failed or given extra promotion. 
The average amount of promotion per pupil was .87 semester. 

It is not fair, however, to compare the promotion rates of the 
two groups of schools directly according to the figures given above. 
The general assumption as to the promotion rate is that it should 
be one semester per semester for pupils of normal mentality who 
are properly classified and working to their full capacity with no 
hindering factors entering into the situation. For pupils whose 
mentalities are above or below normal and who are working under 
the same conditions as those mentioned for normal pupils the theo- 
retical rates of progress are proportionately above or below one 
semester per semester. For example, a pupil with an I. Q. of 125 
would be expected to advance one and one-fourth semesters per 
semester and one with an I. Q. of 80, four-fifths of a semester per 
semester. Thus to render the average promotion figures given in 
the preceding paragraphs strictly comparable each should be divided 
by the average or median I. Q. of the pupils concerned in order to 
bring both to the basis of what they would be for pupils of normal 
mentality, that is, pupils whose I. Q. is 100. 

The measure of progress obtained by dividing the actual average 
rate of progress per pupil by the median intelligence quotient of 
the pupils contributing to this average will be called the “progress 
quotient.” It will be used as the true measure of progress through- 
out this study. Making use of this measure we have as the “pro- 
gress quotient” of the experimental schools .74 divided by 94, and 
for the control schools .87 divided by 1.03. Thus the “progress 
quotients” at this time were 79 for the experimental schools and 
84 for the control schools. The true difference in the promotion 
rate at the beginning of the experiment is thus seen to have been 
only .05 rather than 13 semester. This difference cannot be at- 
tributed to the operation of the experimental plan of organization 
but rather to conditions in the two groups of schools previous to 
the beginning of the experiment and to the preparation necessary 
before the project could be begun. 

The formation of the fast, average and slow sections. As 
a result of the placement in February, 1921, more pupils were placed 
in the slow sections and fewer in the fast sections than would 


usually be the case in most school systems. This was largely due 


[29] 


to the liberal promotion policy that had been pursued before the 
experiment was begun, and to the fact that the pupil material of 
the experimental schools was rather distinctly inferior—median 
I. Q. 94, first quartile 80, third quartile 107. The fast sections 
included 14 percent of the total number of pupils placed, the average 
sections 41 percent, and the slow sections 45 percent. 

The promotion and classification of the pupils for 
September, 1921. It was to be expected that after the experi- 
ment was under way a majority of the pupils in the experimental 
schools would make normal progress in the sections to which they 
had been assigned. The extent to which this expectation was ful- 
filled provided a measure of the efficiency of the previous placement. 
The supplementary principles of promotion and classification given 
in Chapter I suggest various reasons for the failure of many pupils 
to make such progress. 

Table VI, which is similar to the first part of Table V, shows 
the gains and losses resulting from the placement of the pupils in 
the experimental schools for September, 1921. For example, in the 
average section of grade VIA 5 percent of the pupils were placed 
back in the VIA slow section and thus lost one-third of a semester; 
17 percent placed in the VIIB slow section gained two-thirds of a 
semester; 63 percent placed in the VIIB average section gained one 
semester; 11 percent placed in the VIIB fast section gained one and 
one-half semesters and 4 percent placed in the VIITA average section 
gained two semesters. 

At this time 64 percent of the pupils of the experimental schools 
were advanced to the corresponding section of the next grade, but 
as such advancement meant only two-thirds of a semester for the 
slow pupils and one and one-half semesters for the fast, there were 
only 41 percent of the pupils who gained just one semester. In 
addition to the 64 percent mentioned, 26 percent were placed in 
the next grade but in a different section, so that in all 90 percent 
of the pupils of the experimental schools were advanced to the next 
grade. The average progress earned by the pupils in the slow 
sections was .65 semester, that earned by those in the average 
sections was .94 semester, and that by the members of the fast 
sections 1.38 semesters. For all the pupils the average was .88 
semester. Dividing by the median I. Q.’s obtained from the Novem- 


[30] 


; 


q 


c 


TABLE VI. PERCENTS OF THE PUPILS OF THE EXPERIMENTAL 
SCHOOLS GAINING OR LOSING THE GIVEN NUMBER OF SEMES- 
TERS DURING THE SECOND SEMESTER OF 1920-21 


Semesters Gained or Lost 


Grade Costar feces ee tee te eee i A ee ee a ec aS 
el RSs O | +% |] +36] +1 |4+1y% |+1% | +2 142% 


IB | Slow 4 22 60 | 226 4 
Average 21 57 4 
TA | Slow 4 4 46 43 2 i 
Average 1 7 12 58 18 1 1 
Fast 1 4 22 65 1 7 
IIB | Slow 6 5 62 23 3 
Average te 4 18 69 1 
Fast 3 i 24 62 3 
IIA | Slow 5 70 aS 
Average 1 2 1 7 73 10 1 2 
Fast 20 76 4 
IIIB | Slow 6 1 67 24 1 
Average 1 1 22 58 T7, 1 
Fast 2 32 60 2 4 
IIIA | Slow 14 2 68 14 1 
Average 5 3 21 63 6 1 af 
Fast 1 42 51 4 1 
IVB | Slow 10 68 22 
Average 3 2 23 61 5 7 
Fast 7 21 71 
IVA | Slow 2 1 7 6 60 23 1 
Average 1 5 12 59 13 4 5 
Fast 
VB | Slow 6 63 30 2 
Average 5 14 51 30 
Fast + 96 
VA | Slow 1 15 80 3 1 
Average 1 6 17 52 24 
Fast 16 84 
VIB | Slow 13 ZO lO 7 
2 25 54 16 2 
aa 20 | 73 7 
VIA | Slow a 78 19 
17 63 11 4 
Pat on ; 5 20 75 
VIIB | Slow 2 76 | 20 2 
Average 1 12 79 8 
Fast 100 
VIIA | Slow 8 40 | 32 
Average 1 “ 76 19 
Fast 6 94 
VIIIB | Slow 9 90 2 
Average 4 96 
All | All 2 a 4 4 1 36 41 13 ai! 1 1 


*—1% denotes a loss of one and one-third semesters, etc. 
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ber tests, the “progress quotients” were found to be 79, 92 and 118 
for the slow, average and fast sections, respectively. For all the 
pupils of the experimental schools the quotient was 93. 

Table VII shows the same data for the control schools as 
Table VI for the experimental. Of all the pupils in the control 
schools 80 percent were advanced just one semester. This percent 
is practically twice as large as that of the experimental schools, 
but is 10 smaller than the percent of pupils of those schools ad- 
vanced to the same section of the next grade. Only 6 percent of 
the pupils of the control schools received extra promotion, as com- 
pared with the 15 percent in the experimental schools, but 14 
percent were failed or demoted, as compared with only 8 percent 
in the latter group. The average progress in the control group 
was .92 semester. Dividing this by 1.02, a “progress quotient” of 
90 was obtained. Thus, although the average progress of the pupils 
of the control schools was .04 semester greater, their “progress quo- 
tient” was three points smaller. To make the comparison upon a strict- 
ly valid basis, however, the effect of the pupils who left school and 
who entered school during the semester must be considered. Making 
the proper corrections for these pupils,’ the average rate of progress 


TABLE VII. PERCENTS OF THE PUPILS OF THE CONTROL SCHOOLS 
GAINING OR LOSING THE GIVEN NUMBER OF SEMESTERS 
DURING THE SECOND SEMESTER OF 1920-21 


Semesters Gained or Lost 
Grade 
—2 —1 0) +1 +2 +3 +4 +5 
IB 45 53 2 
TA 1 15 Th 13 4 
IIB ley 81 1 
IIA 1 10 88 1 
IIIB 12 87 4 1 4 
IIIA 3 16 81 4 
IVB i 85 i 1 
IVA 2 9 88 1 
VB 11 87 2 1 
VA 1 4 83 1 
VIB 1 90 8 1 
VIA 9 WES 16 
VIIB 1 90 9 
VIIA 5 9) 86 hil 
VIIIB 4 96 
All 1 1 13 80 6 Bh 1 03 


*See Appendix A. 
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of the pupils of the experimental schools was .02 semester less and 
their “progress quotient” four points larger than the corresponding 
figures for the pupils of the control schools. In other words, in so 
far as the progress of the pupils was concerned, the experimental 
schools were more efficient during the second semester of 1920-21 
than were the control schools. The difference in the “progress 
quotient” was just about large enough to balance the difference at 
the beginning of the experiment.* Since this was the case, it cannot 
be assumed that the increased efficiency of the experimental schools 
in the matter of progress was necessarily due to the plan of organi- 
zation used. 


The relative size of the fast, average and slow sections. 
It was again deemed advisable to place many more pupils in the 
slow than in the fast sections. The facts that had made this neces- 
sary a semester earlier still exerted some influence upon the situa- 
tion. The percent of the pupils placed in fast sections at this time 
was 15, and the remainder were equally divided between the 
average and the slow sections. Thus there was an increase of one 
percent in the number of pupils placed in the fast sections and also 
of those in the average sections over the percents for the previous 
semester. 

The placement of the new entrants received by the experi- 
mental schools in September, 1921. The new entrants into 
the experimental schools in September, 1921, were tentatively placed 
in the average sections of the grades indicated by their previous 
school records, and later, after being tested, they were placed as 
the test results and the other data indicated. In the placement 
of pupils at this time no reclassification of the IB pupils was at- 
tempted, because the results obtained from the use of the Kingsbury 
Primary Group Intelligence Scale in that grade were so unsatisfac- 
tory that the writer deemed it unwise to make use of them. Table 
VIII shows that slightly over half of the pupils were not shifted 
at all, that 15 percent gained by the reclassification and 31 percent 
lost by it. The average change made amounted to a loss of 09 
semester, or a promotion of .91 semester from the grades in which 
these pupils were the previous semester. As the median I. Q. of 
the new entrants was 85, their “progress quotient” was 107. 


3See page 29. 
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TABLE VIII. PERCENTS OF THE NEW ENTRANTS INTO THE EXPERI- 
MENTAL SCHOOLS GAINING OR LOSING THE GIVEN NUMBER 
OF SEMESTERS BY THEIR RECLASSIFICATION 
IN SEPTEMBER, 1921 
eS oq 


Semesters Gained or Lost 


Tempo- 
rar | LL |e 
Grade ||-2%|-1%] -1 | —%| o | -+3| +96] +1 [4+16|41%4] +2 |+-2% 
IB* 
JA Dy, 13 53 7 
IIB 10 Diets 52 ll 2 10 
IIA 8 a5 42 8 4 4 
IIIB 7 i 51 25 14 
ITA 23 TL 
IVB 10 2 7, 58 6 6 2 
IVA 38 52 5 5 
VB 7 i255 53 2 14 
VA 19 21 47 8 4 2 
VIB 9 14 59 9 5 5 
VIA 17 13 17 43 4 4 
VIIB 3 12 64 15 3 3 
VITA 29 7 vi, 50 4 
VIIIB 12 Sul 15 42 
VIIA 100 


All ae 2 4 eal Salnos wf io 6 1 x ee ae, 


*As is explained in the text, the pupils in grade 1B were not reclassified at this time. 


Only 9 percent of the new entrants at this time were placed 
in the fast sections. The average sections received 63 percent and 
the slow sections 28 percent. Combining the new entrants with 
the pupils who had been tested in the previous May the percent 
in the fast sections was 15, that in the average 45, and that in the 
slow 41. 


The promotion and classification of the pupils for Feb- 
ruary, 1922. The data obtained in December, 1921, were used 
to determine the placement of the pupils for the second semester 
of the school year. ‘Table IX, which is similar to Table VI, gives 
the percents of the pupils of the experimental schools gaining or 
losing various amounts during the first semester of 1921-22. There 
were 48 percent of the pupils advanced just one semester, as com- 
pared with 41 percent during the previous semester; 35 percent 
made less than one semester’s progress and 17 percent made more, 
as compared with 44 and 15 percent previously. The percent of the 
pupils advanced to the corresponding section of the next higher 
grade was 79, whereas only 64 percent were so advanced a semester 
previously. ‘The percent placed in some section of the next grade 
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TABLE IX. PERCENTS OF THE PUPILS OF THE EXPERIMENTAL SCHOOLS 


GAINING OR LOSING THE GIVEN NUMBER OF SEMESTERS 
DURING THE FIRST SEMESTER OF 1921-22 


Grade - 


IB 


IA 


IIB 


TIA 


IIIB 


IIA 


IVB 


IVA 


VB 


VA 


VIB 


VIA 


VIIB 


VIIA 


Section 


Slow 
Average 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 


Semesters Gained or Lost 


—1%|—1)—% | —4|-¥] 0 +45) +38) +95 | +56 ]4-1)-+-16/+136/+1%] +2 |+2% +246 
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17 


86 


89 


84 


83 


84 


78 


85 


85 


87 


75 


94 


96 


14 


10 


16 


18 


Laie | 


36 


37 


10 


26 


100 


100 


98 


97 


100 


100 


100 


100 


All {All cil Sl) ae : ; 


was almost the same as before, being 89. The average progress 
per pupil was .72 semester for those in the slow sections, .87 
semester for those in the average and 1.49 semesters for the mem- 
bers of the fast sections. The respective “progress quotients” were 
84, 84 and 121. For all the pupils in the experimental schools the 
average progress was .90 semester and the “progress quotient” 91. 
The corresponding figures for the second semester of 1920-21 were 
.88 semester and 93, so it is apparent that the average progress 
was slightly greater and the “progress quotient” slightly less during 
the second semester of the experiment than during the first. 

Table X, which is similar to Table VII, shows the gains and 
losses of the pupils of the control schools according to their place- 
ment at this time. A comparison of these data with those for the 
experimental schools shows that, as before, a larger percent of the 

_pupils of the control schools received normal promotion. The dif- 
ference, however, was not quite as great as the previous semester, 
the figures for this time being 82 and 48 percent as compared with 
80 and 41 percent. The percent of the pupils receiving extra pro- 
motion in the control schools was only half as large as it had been 
a semester earlier, whereas in the experimental schools the corre- 


TABLE X. PERCENTS OF THE PUPILS OF THE CONTROL SCHOOLS 
GAINING OR LOSING THE GIVEN NUMBER OF SEMESTERS 
DURING THE FIRST SEMESTER OF 1921-22 


Semesters Gained or Lost 


Grade 
—3 —2 —1 0 ae! ao are 
IB 33 64 2 oe 
IA 19 80 45) 
IIB 14 82 3 
IIA 17 83 1 
IIIB aS 3 6 91 3 
IIIA 20 80 
IVB 10 83 i 
IVA 6 92 2 
VB 10 84 4 2 
VA 1 6 91 3 
VIB 1 11 85 4 
VIA 1 13 82 4 1 
VIIB 11 88 1 
VITA 1 8 79 13 
VIIIB 9 91 
VIIIA 1 2 9 89 
All il .03 al 14 82 3 2, 


sponding percent was slightly larger. The percent of failures and 
demotions in each group was practically the same as before. The 
average progress per pupil in the control schools was .88 semester 
and the “progress quotient” was likewise 88. Hence the average 
Progress was .02 semester greater in the case of the experimental 
schools and the “progress quotient” three points greater. Had it not 
been for the new entrants and eliminees, the difference in average 
progress would have been .01 semester greater. Thus it can be 
said for the second semester of the experiment, as for the first, that 
in so far as the progress of the pupils was concerned, the experi- 
mental schools were somewhat more efficient than were the control 
schools. 

The classification into fast, average and slow sections for 
the second semester of 1921-22. The percents of the pupils 
placed in the sections at this time differed rather markedly from 
those for previous semesters. The percent placed in the fast sections 
showed only a slight decrease, but that in the slow sections de- 
creased about one-third. The percents were 13 in the fast sections, 
57 in the average and 30 in the slow sections. These figures give 
evidence that as the experiment progressed it was possible to place 
pupils more nearly as would be expected from theoretical consid- 
erations. 

The promotion and classification of the pupils for 
September, 1922. After the testing in May, 1922, which was the 
last during the experiment, the pupils of the experimental schools 
were placed for the first semester of 1922-23. ‘Table XI, which is 
similar to Tables VI and IX, shows the gains and losses of the 
pupils of the experimental schools during the second semester of 
1921-22. There were 55 percent of the pupils who gained just one 
semester as compared with 48 percent during the previous semester, 
28 percent who made less than one semester’s progress as compared 
with 35 percent, and 17 percent who made more, the same as the 
previous semester. Only 58 percent of the pupils were advanced 
to the corresponding section of the next higher grade as compared 
with 79 percent a semester previously. The percent placed in some 
section of the next grade was 89, just the same as it had been. 
The average progress per pupil was .62 semester for those in the 
slow section, .98 semester for those in the average, and 1.39 for 
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TABLE XI. PERCENTS OF THE PUPILS OF THE EXPERIMENTAL 
SCHOOLS GAINING OR LOSING THE GIVEN NUMBER OF 
SEMESTERS DURING THE SECOND SEMESTER OF 1921-22 


Semesters Gained or Lost 


Grade Section 
-1%| -1|—x%]—x%] 0 [+x] +] +2] +1] +134]-+1%] +2 [42% ]+2% 
IB Slow 37 46 | 17 
Average 12 22 | 66 
IA Slow 1 30 | 33 36 
Average 20 69 11 “2 
Fast 3 Si 21 66 5 
IIB Slow 10 90 
Average 9 75 4 12 
Fast 21 7) 
IIA Slow 5 94 2 
Average 5 81 12 2 
Fast 4 83 13 
IIIB Slow 19 81 
Average 12 81 7 
Fast 16} 65 18 
IIIA Slow 11 89 
Average 5 79 14 2 
Fast 95 5 
IVB Slow 6 94 
Average 5 77 18 
Fast 19 | 78 4 
IVA Slow 6 94 
Average 1 6 82 8 33 
Fast 100 
VB Slow 1 3 96 
Average 2 93 1 
Fast 100 
VA Slow 100 
Average 3 86 7 3 
Fast 
VIB Slow 99 1 
Average 2 85 6 6 
Fast 8 92 
VIA Slow 100 
Average 5 6 83 6 
Fast 18 82 
VIIB Slow 8) 26 71 
Average 3 92 2 2 
Fast 31 63 6 
VITA Slow 6 94 
Average 89 8 3 
Fast 100 
VIIIB Slow 3 97 
Average 4 96 
Fast 38 63 
VITIA Slow 100 
Average 4 96 
All All .03| .03} .03| 1 6 1 S212 S5: 14 a2 03 
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members of the fast sections. The respective “progress quotients” 
were 76, 98 and 114. For all pupils of the experimental schools 
the average progress was .94 semester and the “progress quotient” 
97. These figures show both greater actual progress and greater 
progress relative to ability than was made during either of the 
previous semesters. 

Table XII, which is similar to Tables VII and X, shows the 
gains and losses of the pupils of the control schools for this semester. 
Again more pupils of the control schools received normal promo- 
tion than was the case in the experimental schools, the difference, 
however, being smaller than it was in either of the previous semes- 
ters. The percent of the pupils receiving extra promotion was 
only one-third as large as in February, 1922, whereas in the 
experimental schools it was the same. The percent of failures and 
demotions in the control schools was slightly less than in February, 
the decrease being in about the same ratio as that in the experi- 
mental schools. The average progress per pupil in the control 
schools was .89 semester and the “progress quotient” 86. Thus 
the average progress was .05 semester greater in the case of the 
experimental schools and the “progress quotient” eleven points greater. 


TABLE XII. PERCENTS OF THE PUPILS OF THE CONTROL SCHOOLS 
GAINING OR LOSING THE GIVEN NUMBER OF SEMESTERS 
DURING THE SECOND SEMESTER OF 1921-22 


Semesters Gained or Lost 


Grade SSS ee Lee ae 
—1 0 +1 +2 +3 
IB 8 69 23 
IA 4 18 81 1 
IIB 16 83 2 
IIA 10 90 
IIIB 8 91 1 
IIIA 24 75 1 
IVB 8 90 2 
IVA 10 90 
VB 13 86 1 1 
VA 6 94 
VIB 8 92 
VIA i 92 1 
VIIB 3 9 85 1 1 
VIIA 16 83 1 
VIIIB u a 
MG 2 12) 87 1 1 
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The new entrants and eliminees did not affect these differences. 


The classification into fast, average and slow sections 
for the first semester of 1922-23. The percents of the 
pupils placed in the sections for September, 1922, again differed 
considerably from those for previous semesters. The percent in 
the fast sections was practically the same, 14, but that in the average 
sections rose to 68 and that in the slow sections dropped to 18. Thus 
the tendency already noted for the fast and slow sections to ap- 
proximate each other in size was continued as the experiment 
progressed longer. Probably the distribution at this time was about 
what it should be, as there will always be more pupils belonging 
in slow sections because of not realizing their highest possible 
achievement than there will be pupils belonging in fast sections 
because of doing more than should be expected of them. 


Summary. As a result of the placement of the pupils at the 
beginning of the experiment the “progress quotient” for the experi- 
mental schools was, at that time, five points smaller than that for 
the control group. During the course of the experiment this situa- 
tion was reversed. Averaging the “progress quotients” for the three 
semesters, those for the experimental group were the larger by 
about six points. Thus the net result of the experimental plan of 
organization in so far as progress was concerned was favorable. 
The greater degree of efficiency of the experimental schools seems 
to have been due to the operation of this plan. 
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CHAPTER IV 


THE EFFICIENCY OF THE TWO GROUPS OF SCHOOLS AS 
MEASURED BY THE ACHIEVEMENTS OF THE PUPILS 


In Chapter III, one of the two factors which were taken as 
constituting output has been discussed. In this chapter the other 
factor, that of achievement, will be considered both absolutely and 
in its relation to capacity. It has been shown in the preceding 
chapter that there was an increase in the “progress quotient” of 
the experimental schools as compared with that of the control 
schools. Therefore if a study of the achievements of the pupils of 
the two groups of schools shows that those of the experimental 
schools were either equal to or greater than those of the control 
schools, it may be said that the experimental schools were more 
efficient than the other group during this experiment. 

The gains in absolute achievement during the second 
semester of 1920-21. ‘Table XIII gives the median achievement 
ages of the grades and sections of the two groups of schools at the 
beginning and end of the second semester of 1920-21. A compari- 
son of the first and fourth columns shows that at the beginning of 
this semester the median achievement age of the control schools 
was four months greater than that of the experimental schools, 
while at the end of this semester the median ages were the same. 
In other words, the gain in achievement age on the part of the 
experimental schools was four months more than that of the control 
schools. The cause of this increase cannot be stated with certainty. 
There are at least two explanations that may account for it. One 
of these is that it resulted from the same causes which accounted 
for a similar increase in the mental ages. The increase in the 
median mental age of the pupils of the experimental schools was 
five-tenths of a year greater during this semester than was that of 
the control schools. In the opinion of the writer the most potent 
cause of the greater increases in both mental and achievement ages 
on the part of the experimental schools was the fact that both the 
teachers and the pupils of those schools felt a very high degree of 
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TABLE XIII. MEDIAN GRADE AND SECTION ACHIEVEMENT AGES 
OF THE PUPILS OF THE TWO GROUPS OF SCHOOLS AT THE 
BEGINNING AND END OF THE SECOND SEMESTER 


OF 1920-21 
Experimental Control 
Secti a a Ad te 
ERIS can oP lise iene eR Gain* || Beginning | End Gain 
IA Slow 6-4 10-5 49 
Average 6-8 10+4 44 6-2 10-0 46 
Fast 5-6 10-10 64 
IIB Slow 64 8-8 28 
Average 6-5 9-10 41 7-11 8-0 1 
Fast 8-6 8-4 =h 
IIA Slow 6-7 9-5 34 
Average 7-7 9-10 27 7-10 9-7 21 
Fast 8-1 9-6 17 
IIIB Slow 8-2 10-10 32 
Average 8-11 10-7 20 9-0 10-9 21 
Fast 8-8 11-1 29 
IIIA Slow 9-1 9-1 0 
Average 10-1 10-1 0 9-8 10-1 5 
Fast 9-10 9-8 2 
IVB Slow 8-11 10-8 21 
Average 10-0 10-7 7 9-1 10-10 21 
Fast 9-11 12-6 31 4 
IVA Slow 9-5 11-7 26 
Average 10-7 14-0 +h 10-0 10-0 0 
Fast Mia wee see 
VB Slow 9-8 12-1 29 
Average 10-10 134 30 10-7 12-2 19 
Fast 10-10 13-2 28 
VA Slow 10-4 11-4 12 
Average 11-5 13-6 25 11-5 1344 23 
Fast 13-0 14-7 19 
VIB Slow 10-0 12-1 25 
Average 11-10 12-10 12 12-0 13-8 20 
Fast 13-6 15-1 19 
VIA Slow 11-11 14-5 30 
Average 12-8 15-1 29 12-1 13-10 21 
Fast 15-0 15-0 0 
VIIB Slow 12-5 15-5 36 
Average 12-5 16-6 49 14-2 14-8 6 
Fast 15-4 17-0 20 
VIIA Slow 12-7 14-11 28 
Average 13-6 17-8 50 15-0 16-1 13 
Fast 16-1 18-5 28 
VIIIB Slow 11-11 13-6 19 
Average 14-0 16-7 31 15-1 16-1 12 
All All 10-0 11-6 18 10+4 11-6 14 


*The gains are given in terms of months. 
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TABLE XIV. MEDIAN GRADE AND SECTION ACHIEVEMENT QUO- 
TIENTS OF THE TWO GROUPS OF SCHOOLS AT THE BEGINNING 
AND END OF THE SECOND SEMESTER OF 1920-21 


Grade 


IA 


IIB 


IIA 


IIB 


IIA 


IVB 


IVA 


VB 


VA 


VIB 


VIA 


VIIB 


VITA 


VIIIB 


All 


interest in the results 
was largely depende 
teachers and pupils 
would be made of th 


Section 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 
Fast 


Slow 
Average 


All 


Beginning End Gain 


Experimental 

116 13 
118 30 
128 63 
100 =f 
109 23 
105 2 
112 23 
111 19 
110 22 
120 9 
111 5 
112 9 
104 —10 
115 1 
104 —4 
106 = 
106 —0 
108 Zz 
110 3 
118 12 
112 

109 1 
108 10 
108 2 
116 6 
118 13 
110 8 
108 4 
106 —4 
119 4 
118 10 
121 6 
120 12 
122 17 
117 12 
106 —2 
119 16 
122 17 
104 5 
113 20 
112 6 


nt upon these results. 
of the control schools knew that no direct use 


e test results, hence naturally took less interest 


[43] 


Beginning 


91 


Control 

End Gain 
117 26 

95 =A) 
111 21 
118 15 
112 —3 
112 2 
103 0 
110 5 
112 6 
114 5 
115 10 
108 5 
113 12 
111 6 
112 8 


of the tests because they knew that placement 


On the other hand, the 


in the testing. The other explanation is that the experimental plan 
of organization caused the increase. Inasmuch as there is generally 
a fairly high correlation between the scores made on intelligence 
tests and those on subject-matter tests, especially in the case of 
verbal intelligence and reading tests, the writer believes that the 
first explanation is the true one or at least more nearly so than the 
latter. It is not unlikely that both had a part in causing the rela- 
tive increase. 

The achievement quotients at the beginning and end of the 
second semester of 1920-21. Table XIV shows that at the be- 
ginning of this semester the median achievement quotient of the 
experimental schools was two points higher than that of the control 
schools. We have seen that both the intelligence and the achieve- 
ment scores made at the end of the semester showed a greater in- 
crease in the case of the experimental schools than in that of the 
other group, but that the increase in intelligence on the part of 
the experimental schools was slightly greater than that in achieve- 
ment. Moreover, both groups showed greater increases in achieve- 
ment than in intelligence. Therefore we expect to find, as we do, 
that the median achievement quotients of both groups of schools 
increased during this semester, and that the increase in the case 
of the control schools was slightly greater. This difference was 
two points. Thus at the end of the semester the two medians 
were the same. The general import of this evidence is that in so 
far as achievement was concerned there was a slight relative in- 
crease in the efficiency of the control schools. 


The correlation of intelligence and achievement at the 
beginning and end of the second semester of 1920-21. Al- 
though the achievement quotient measures the relation of intelli- 
gence and achievement in one way, this relation may also be meas- 
ured by means of the coefficient of correlation. The following table 
shows the coefficients that were found at the beginning and end of 


the semester by correlating the mental and achievement ages for 
all grades combined: 


Experimental Control 
Beginning End Loss Beginning End Loss 
260==.01 256-5201 ak 602.01 .51=.01 09 


It is evident that in both groups there was a decrease in the 
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correlation of achievement with intelligence as measured by the 
tests used. This decrease was slightly greater in the case of the 
experimental schools, but the difference was not great enough to 
be significant. It may be that this decrease was due to a lessening 
of the degree to which instruction was adapted to the capacities 
of the pupils. It is likely, however, that much, if not all, of the 
decrease was caused by the fact that the mental ages calculated at the 
beginning of the semester were based upon the average scores 
made on two intelligence tests and hence were more reliable than 
those obtained at the end of the semester, which were based upon 
only one test score. This lower degree of reliability would natur- 
ally tend to reduce the correlation between the mental and the 
achievement ages. 

The relation of the intelligence and achievement quo- 
- tients at the beginning and end of the second semester of 1920- 
21. The median achievement quotients of the groups of different 
levels of intelligence as determined by the intelligence quotients 
were computed for the end of the semester as they had been at 
its beginning. Table XV presents a comparison of those found at 
the two periods. The achievement quotients of the different groups 
at the end of the semester showed that in the experimental schools 
instruction was adapted about equally well to the pupils of different 


TABLE XV. MEDIAN ACHIEVEMENT QUOTIENTS OF THE PUPILS OF 
DIFFERENT LEVELS OF INTELLIGENCE AT THE BEGINNING 
AND END OF THE SECOND SEMESTER OF 1920-21 


Achievement Quotients 


Hee Experimental Control 

Beginning End Beginning End 
150-59 104 117 98 103 
140- 95 122 95 113 
130- 102 113 98 107 
102 113 102 109 

120- 
101 112 101 109 

110- 
102 113 102 113 

100- 
104 111 104 113 

90- 
103 113 105 114 

80- 
107 115 110 117 

70- 
60- 113 116 114 120 
50- 109 128 125 120 
All 105 112 104 112 
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levels of intelligence, whereas in the control schools the previous 
well-marked tendency to adapt instruction more nearly to the 
capacities of the inferior pupils remained. As this tendency was 
present in both groups of schools at the beginning of the semester 
it is evident that there was a relative improvement in the degree 
to which the instruction in the experimental schools was adapted 
to pupils of one level of intelligence as well as to those of ‘another. 

The coefficients of correlation of the intelligence and achieve- 
ment quotients were also found and compared with those for the 
beginning of the semester. The following table presents this com- 
parison: 


Experimental Control 
Beginning End Gain Beginning End Gain 
—.16+.01 —.12+.01  .04 —.28+.01 —.25+.01  .03 


This comparison shows that at the close of the semester the nega- 
tive correlations between the intelligence and achievement quotients 
were slightly smaller in the cases of both of the groups of schools. 
The difference in the gains was so small that it has no significance. 
This fact shows that the instruction given in the control schools 
was still somewhat less equally suited to pupils of all levels of 
intelligence than was that of the experimental schools. In the 
main this corroborates the evidence presented in the preceding 
paragraph. 

The gains in absolute achievement during the first semes- 
ter of 1921-22. Table XVI, which contains data corresponding 
to the third and sixth columns of Tables XIII and XIV, shows 
that the increase in absolute achievement during this semester was 
seven months of achievement age in the experimental schools and 
four months in the control schools. As during this same semester 
the median mental age of the experimental schools did not increase 
as much as did that of the control schools it seems fair to attribute 
the greater gain in achievement to an increase in the efficiency of 
the experimental schools. It was shown in the preceding chapter 
that during this same semester the “progress quotient” of this group 
of schools was greater than that of the control group, therefore 
this increase in efficiency in so far as achievement is concerned 
cannot be attributed to a slowing up of the progress of the pupils. 
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TABLE XVI. GRADE AND SECTION GAINS AND LOSSES IN ACHIEVE- 


MENT AGES AND QUOTIENTS OF THE TWO GROUPS OF 
SCHOOLS FROM THE BEGINNING TO THE END 


Achievement Ages 


OF THE FIRST SEMESTER OF 1921-22 


Achievement Quotients 


Grade Section 
Experimental Control Experimental Control 
IA Slow 16 12 
Average 23 —2 7 6 
Fast 8 —19 
IIB Slow —20 —1l 
Average —14 —18 -19 —31 
Fast —il1 —13 
IIA Slow 11 18 
Average 7 6 —2 —21 
Fast 5 10 
IIIB Slow 8 il 
Average 17 12 —11 —32 
Fast 16 -—8 
IIA Slow —15 -11 
Average —17 —16 —7 —12 
Fast —10 —10 
IVB Slow 10 —4 
Average 15 4 aa = 
Fast 21 —5 
IVA Slow 23 1 
Average 22 =a 1 —18 
Fast 67 12 
VB Slow 20 ul 
Average 5 17 —10 =1 
Fast —2 —25 
VA Slow 12 eal 
Average —6 18 =15 2 
Fast 6 =o 
VIB Slow 17 a8 
Average 19 8 —3 =8 
Fast —49 -2 
VIA Slow 14 —1 
Average 2 8 —1l as 
Fast —29 =e 
VIIB | Slow 19 Gs 
Average 18 0 rs Be 
Fast 35 2 
VIIA | Slow 5 ae 
Average 10 3 = 2 
Fast 27 rs 
VIIIB | Slow —19 zy 
Average —8 1 =e aa 
Fast —15 ae 
—7 
VIIA Slow 7 Ls 
Average 12 —3 3 uy 
All 7 4 =f as 


oe ee) 


Pad yy 


The achievement quotients at the beginning and end of the 
first semester of 1921-22. The median achievement quotients of 
both groups of schools were smaller at the end of this semester 
than they were at its beginning. In other words, the average in- 
crease in the scores made upon the intelligence tests was consid- 
erably greater than that in those upon the achievement tests. ‘This 
would seem to point to the fact that the practice effect upon the 
intelligence tests was greater than that upon the others. As Table 
XVI shows, the decrease in the median achievement quotient of 
the experimental schools was eight points, whereas that in the 
control schools was thirteen points. Thus the loss of the experi- 
mental schools was five points less than that of the other group, 
or, in other words, their relative gain was that large. This sup- 
ports the conclusion reached above from the study of the mental 
and achievement ages, that the efficiency of the experimental schools 
during the semester was greater than that of the control schools. 

The correlation of achievement and intelligence at the 
beginning and end of the first semester of 1921-22. The fol- 
lowing table compares the coefficients of correlation found at the 
end of the semester with those at the beginning: 


Experimental Control 
Beginning End Loss Beginning End Loss 
56.01 .54+.01 02 aeeioil oilesdon .00 


Judging from these coefficients, it seems that there was practically 
no change in the relation of achievement to intelligence during this 
semester. ‘The slight decrease of .02 on the part of the experimental 
schools was too small to have any significance. 

The relation of the intelligence and achievement quo- 
tients at the beginning and the end of the first semester of 
1921-22. ‘Table XVII shows the same facts for this semester as Ta- 
ble XV for the previous semester. At the end of this semester there 
was a rather definite decrease in the achievement quotient medians of 
the experimental schools from the duller to the brighter pupils. 
This tendency was even more marked in the control schools. 
Inasmuch as at the beginning of the semester this tendency was 
not noticeable in the experimental schools but was present in the 
control schools the figures for the end of the semester indicate that 
relatively the condition which they measure became worse in the 
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TABLE XVII. MEDIAN ACHIEVEMENT QUOTIENTS OF THE PUPILS OF 
DIFFERENT LEVELS OF INTELLIGENCE AT THE BEGINNING 
AND END OF THE FIRST SEMESTER OF 1921-22 
eaao<(€wzxsexqx*q#D@OOoOOOOOOOOoOoOooOoownaws=@oa=“O0a oo 

Achievement Quotients 


“Samoa e Experimental Control 

Beginning End Beginning End 
150-59 117 98 103 85 
140- 122 96 113 88 
130- 113 102 107 95 
120- 113 100 109 99 
110- 112 102 109 104 
100- 113 106 113 105 
90- 111 106 113 105 
80- 113 110 114 107 
70- 115 111 117 113 
60- 116 114 120 119 
50- 128 125 120 132 
All 112 105 112 104 


experimental schools. That is to say, during this semester there 
was a relative loss in the degree to which instruction was equally 
well adapted to pupils of all levels of intelligence in the experimental 
schools. ‘The writer is unable to suggest any probable explanation 
of this fact. 

A comparison of the coefficients of correlation of the intelli- 
gence and achievement quotients at the end of the semester with 
those at the beginning supports the conclusion given above. These 
coefficients were as follows: 


Experimental Control 
Beginning End Loss Beginning End Loss 
—.12+.01 —.36+.01 .24 —.25+.01 —39+.01 .14 


This comparison shows that the correlation between the intelligence 
and achievement quotients became considerably greater, negatively, 
during the semester. The change was much larger in the experi- 
mental schools. This fact emphasizes the conclusions presented in 
the last two paragraphs to the effect that there was a relative 
decrease in the degree to which the experimental schools capitalized 
the capacities of their pupils into achievement. ‘This decrease is 
even more definitely shown by these coefficients than by the data 
given previously. 

The gains in absolute achievement during the second 


semester of 1921-22. Table XVIII, which is similar to’Table XVI, 


bean 


TABLE XVIII. GRADE AND SECTION GAINS AND LOSSES IN ACHIEVE- 
MENT AGES AND QUOTIENTS OF THE TWO GROUPS OF 
SCHOOLS FROM THE BEGINNING TO THE END 
OF THE SECOND SEMESTER OF 1921-22 


. Achievement Ages Achievement Quotients 
Grade Section el 
Experimental Control Experimental Control 

IA Slow 35 25 
Average 40 18 45 4 

Fast 47 16 

IIB Slow 3 7 
Average ii 0 12 —t 

Fast —7 5 

IIA Slow 11 7 
Average 10 15 10 iW 

Fast 6 25 

IIIB Slow 1 —3 
Average if 16 2 19 

Fast if 10 

IIIA Slow —16 —6 
Average —15 —4 -9 13 

Fast —2 16 

IVB Slow 6 1 
Average 4 16 2) 12 

Fast 15 3 

IVA Slow 5 ue 
Average 13 19 9 11 

Fast 12 20 

VB Slow 0 8 
Average 10 12 11 ll 

Fast 7 11 

VA Slow 8 13 
Average 12 3 10 4 

Fast 10 13 

VIB Slow 20 23 
Average 17 5 13 5 

Fast 16 17 

VIA Slow 6 ae 
Average 5 3 8 7 

Fast 4 3 

VIIB Slow 34 17 
Average y) —12 5 = 

Fast -9 10 

VIIA Slow —23 —5 
Average 2 6 8 2 

Fast 9 9 

VIIIB Slow 18 14 
Average —6 25 1 17 

Fast —19 —1 

VIIIA Slow 6 —16 
Average —11 20 1 ih 
All All 7 4 7 6 
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shows that the increase in absolute achievement during the second 
semester of 1921-22 averaged seven months in the experimental 
schools and four months in the control schools. Thus again it 
appears that the experimental schools were more efficient as regards 
the achievement of their pupils. As their “progress quotient” was 
considerably greater during this semester the gain in absolute 
achievement can not be attributed to holding back the pupils. 

The achievement quotients at the beginning and end of the 
second semester of 1921-22. Table XVIII likewise presents the 
gains of the two groups of schools in achievement quotients. Ac- 
cording to these quotients the gain of the experimental schools 
was only one point greater than that of the control schools. 

The correlation of achievement and intelligence at the 
beginning and end of the second semester of 1921-22. The 
coefficients of correlation between absolute achievement and intelli- 
gence at the beginning and end of this semester were as follows: 


Experimental Control 
Beginning End Gain Beginning End Gain 
.54+.01 .75+.01 21 AMIESsO Aes 40il 02 


Judging from these coefficients it seems that there was a very de- 
cided gain in the relation of achievement to intelligence on the part 
of the experimental schools, but practically no change in the control 
schools. 

The relation of the intelligence and achievement quo- 
tients at the beginning and end of the second semester of 1921- 
22. Table XIX, which is similar to Tables XIII and XVII, pre- 
sents the relation of the achievement and intelligence quotients for 
the second semester of 1921-22. Comparing the figures for the 
beginning and end of this semester there seems to have been no 
noticeable change in the situation. 

A comparison of the coefficients of correlation of the intelligence 
and achievement quotients is more favorable to the experimental 
schools. ‘These coefficients were as follows: 


Experimental Control 
Beginning End Gain Beginning End Loss 
—.36+.01 —.34.01 .02 —,39+.01 —.52=.01 il} 


The change in the coefficients of the control schools showed a de- 
crease in the adaptation of instruction to pupils of all levels of 
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TABLE XIX. MEDIAN ACHIEVEMENT QUOTIENTS OF THE PUPILS OF 
DIFFERENT LEVELS OF INTELLIGENCE AT THE BEGINNING 
AND END OF THE SECOND SEMESTER OF 1921-22 


Achievement Quotients 


a ; : Experimental Control 

Beginning End Beginning End 
150-59 98 89 85 88 
140- 96 99 88 3p) 
130- 102 106 95 101 
120- 100 109 99 104 
110- 102 108 104 109 
100- 106 112 105 111 
90- 106 115 105 112 
80- 110 114 107 118 
70- 111 121 113 119 
60- 114 131 119 128 
50- 125 125 132 131 
All 105 113 104 109 


intelligence, but in the experimental schools such adaptation seems 
to have remained about the same. 


The achievements of the two groups of schools during the 
second semester of 1921-22 as measured by the Omnibus Test. 
In planning this experiment it was decided to make use of tests 
in reading and arithmetic because those are generally considered 
the two most important subjects of the elementary curriculum and 
further because it was believed that the results obtained would 
give a fairly reliable index of the achievements of the pupils in all 
subjects. In order to provide a partial check upon this latter 
assumption a test was devised by the writer and given to the pupils 
of grade VIB and above at the regular testing period in May, 1922. 
This test, which was called the Omnibus Test, contained questions 
in geography, history, grammar, elementary science and certain 
phases of arithmetic not covered by the standardized tests used. 
The scores made on this test were translated into achievement 
ages and quotients in the same way as for the other tests of 
achievement. 

Table XX presents the median ages and quotients for the 
various grades and sections of the two groups of schools. It may 
be seen from this table that the showing made upon this test by 


1See Appendix C. 
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TABLE XX. MEDIAN GRADE AND SECTION OMNIBUS ACHIEVEMENT 
AGES AND QUOTIENTS OF THE PUPILS OF THE TWO GROUPS OF 


SCHOOLS AT THE END OF THE SECOND SEMESTER OF 1921-22 
EE 


Ages i 
Grade Section 5 an gu Aa el ta Se Sear 
Experimental] Control ||Experimental] Control 

VIB Slow 10-8 97 
Average 12-3 10-10 102 88 

Fast 10-8 90 

VIA Slow 10-8 85 
Average 11-1 15-2 89 120 

Fast 12-2 85 

VIIB Slow 11-10 95 
Average 12-0 14-10 92 109 

Fast 15-3 100 

VIIA Slow 11-1 86 
Average 14-9 14-4 102 107 

Fast 16-8 ° 114 

VIIIB Slow 12-11 98 
Average 13-5 15-7 87 108 

Fast 15-2 90 

VIIIA Slow 11-7 88 
Average 14-11 17-3 96 111 
All 12-8 14-11 94 107 


the control schools was very much better than that made by the 
experimental schools. The average difference was over two years 
of achievement age and thirteen points of achievement quotient. 
Inasmuch as the pupils were not given a similar test at any pre- 
vious time the relative gain can not be computed. The difference 
between the two groups is so great, however, that it is evidently 
significant. A very probable conclusion is that in the experimental 
schools there was a tendency to emphasize the instruction in read- 
ing and arithmetic to the neglect of that in the other subjects. This 
tendency was probably not due to the fact that the teachers and 
pupils were consciously striving to prepare to make better scores upon 
the tests but that merely through the use of the tests in reading 
and arithmetic attention was called to pupils’ weaknesses in these 
subjects and therefore unusual care was taken to correct these 


weaknesses. 
Individual opinion as to the relative importance of arithmetic 
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and reading as compared with the elementary school subjects cov- 
ered by the Omnibus Test will largely determine one’s belief as 
to whether or not the experimental schools made a relative gain in 
achievement during the course of the experiment. Inasmuch as 
there was an average relative gain of only about one point per semes- 
ter in the achievement quotient on the part of the experimental 
schools it is the opinion of the writer that there was not any 
greater efficiency in the achievement of this group of schools. On 
the other hand, he does not believe it should be asserted that in 
so far as achievement was concerned there was a decidedly smaller 
degree of efficiency. 


Summary. The data presented in this chapter considering 
them from the standpoint of the experimental schools relative to 
the control schools may be briefly summarized as follows: 


1. At the beginning of the experiment the median achievement 
age as measured by the tests used was four months lower. 
During the experiment slightly greater efficiency was shown, 
averaging about one month per semester, according to the 
reading and arithmetic test results. According to the results 
on the Omnibus Test, however, the median achievement age 
was twenty-seven months lower at the conclusion of the 
experiment. 


2. The median achievement quotient derived from the arith- 
metic and reading tests was two points greater both at the 
beginning and end of the experiment. Allowing for the 
effect of the new entrants and eliminees, however, there 
was a relative gain of about one point per semester. The 
Omnibus Test achievement quotient was thirteen points 
lower. 


3. The correlation of intelligence and achievement was .08 
greater at the beginning and .25 greater at the close of the 
experiment. 

4. At the beginning of the experiment instruction was some- 
what better adapted to the inferior than to the superior 
pupils in both groups of schools. On the whole there was 
little change in this situation. 


Considering these items together it seems that in so far as 
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achievement was concerned the efficiency of the experimental 
schools was no greater than that of the control schools. ‘The slightly 
greater efficiency in reading and arithmetic was at least balanced 
by the results of the Omnibus Test. If we assume that the meas- 
urement of achievement shows no advantage for either group of 
schools it may be said that the experimental plan of organization 
was more efficient than the traditional plan because of the fact that 
the progress of the pupils was considerably greater in the experi- 
mental than in the control schools. If, on the other hand, it is 
considered that the Omnibus Test showed a distinctly greater de- 
gree of efficiency as regards the total achievement for the control 
schools, this must be balanced against the greater progress made 
in the other group and a less definite conclusion reached. 
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CHAPTER V 


A STUDY OF THE PUPILS WHO REMAINED IN SCHOOL 
THROUGHOUT THE COURSE OF THE EXPERIMENT 


Although there was no reason to suspect that a study of the 
records of the pupils who participated in this experiment through- 
out the three semesters that it continued would yield results and 
conclusions materially different from those presented in Chapters 
III and IV, yet it was thought desirable to make such a study. 
Therefore this chapter will present certain data concerning the 
pupils who were in the schools in February, 1921, and remained 
therein until the close of the experiment. ‘These pupils did not 
compose as large a group as might be expected because the pupil 
population of both groups of schools was very unstable. Slightly 
less than 60 percent of the pupils tested at the beginning of the 
experiment were still in the schools at its conclusion. In making 
a study of these pupils the tabulations were not made by separate 
semesters but all three semesters were taken together. 

The placement of the pupils and their progress through- 
out the grades. Tables XXI and XXII show the percents of 
pupils in the two groups of schools gaining or losing the given 
number of semesters during the three semesters that the experi- 
ment continued. From these tables it may be seen that only 34 
percent of the pupils of the experimental schools made just three 
semesters of progress, whereas 62 percent of those of the control 
schools did so. The percents making more than this amount of 
progress were 26 and 7, respectively, and those making less, 40 
and 32, ‘The average amount of progress made was 2.79 semesters 
in the experimental schools but only 2.67 semesters in the control 
schools, Dividing these figures by three to reduce them to a semes- 
ter basis and then by the median I, Q.’s gives “progress quotients” 
of 93 and 89, respectively. Therefore it appears that in so far as 
progress was concerned the experimental plan of organization was 
somewhat more efficient for those pupils remaining in school 
throughout the experiment than was the traditional plan. The 
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TABLE XXI. PERCENTS OF THE PUPILS OF THE EXPERIMENTAL 
SCHOOLS PRESENT THROUGHOUT THE EXPERIMENT THAT 
GAINED OR LOST THE GIVEN NUMBER OF SEMESTERS 


er 
aee—aeaoeoeoeoooooas$S< OawsK—wWwnOWDSOOOOOS ee eeeeeeS”zeK°e:roo 


ree se ee ee eee Oe POET Sernceters Gaindd orloet = 8) PAY 
Grade Section —5) —1) 0 | +1) 42/4234] +3/+334] +4)+434] +5/+5%] +6] +7]+10] +11 
IB | Slow PHM NEA | costes W20) 2 
Average 11 | 28 il 33 25 2 
IA | Slow 1 3 OSB ie sen) 8 2 
Average 4) 15 44 | 14 ily 3 1 1 
Fast 4 THE WANS VPA | pd AP Pl 29) 
IIB | Slow 25 olay 2eiisa § 2 
Average 6 | 33 9 sire ) i) 
Fast Ses 36 PAY MS PME 
IIA | Slow 1 8 | 59 250 4. 1 1 
Average 1 2 hele SZHeLE ill ey 
Fast 6 13h 2928 19932 
IIIB | Slow 1 8 | 59 LOM EL? 1 
Average 6 | 27 47 | 8 2 4 4 2 
Fast SMO MO | see ie oer 7 tedieel|| Os || med: 
IIIA | Slow 1 17 | 47 Zaha ie 2 3 
Average 7 | 20 39 | 16 | 10 4} 3 
Fast PHA he 38} al aa 1s ol at bs ada be aS 
IVB | Slow 7 | 46 31 7. 7 1 
Average 19 36 8 25 6 6 
Fast 2 4 3) 2 1 
IVA | Slow 1 8 | 44 42 | 4 
Average 2 | 16 AVS eel ZOL|\eed bale sa ere 
Fast 
VB | Slow 1 5 | 54 26S: 53 4 
Average 14 39) eid thal) PAE 2 
Fast 5 11 16 | 67 
VA | Slow 10 | 54 28 1 6 
Average Z 22 44 | 13 11 8 
Fast 20 COON 13°) 7 
VIB | Slow 13 | 20 yl atl 5 5 
Average 3} 14 57 12 12 2 
Fast 137 es 7 \\ Zee 
VIA | SI 2 9 | 61 AMM Fé 
hearse 20 46118 | 16 
Fast 10 10 80 
VIIB | Slow 7 | 60 33 
Average 16) | 22. 1583 
Fast 
VIIA | Slow 100 
Average Sapo 
Fast 100 
VIIIB | Slow 
Average 100 
VIIIA | Slow 
Average 
All All 04) .04] .4/ 7132) 1 BAe erlnLO 7 1 4] .21 04] .04) .04 


emerieemeen et i ie hs ee 
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TABLE XXII. PERCENTS OF THE PUPILS OF THE CONTROL SCHOOLS 
PRESENT THROUGHOUT THE EXPERIMENT THAT GAINED OR LOST 
THE GIVEN NUMBER OF SEMESTERS 


ee ee ee ee 
DS  ————————————————————ee 


February 
1921 =f 0 +1 | +2 | 43 |) +4 | +5 [ack 
Grade 
IB 1 16 51 30 3 
IA 1 i 24 55 13 
IIB 7 37 56 1 
IIA 1 4 31 60 3 
IIIB 1 6 25 64 2 3 
IIIA 4 5 26 58 7 
IVB 3 16 76 3 a 
IVA ft 23 73 Dp} 
VB 1 17 78 2 1 
VA 3 iy 62 Ae, 1 
VIB 21 69 10 
VIA 2 22 64 12 
VIIB 5 20 75 
VIIA 7 i 87 
VIIIB 
All 1 1 5 26 62 6 Ape 3 


” especially when 


difference of four points in the “progress quotients, 
it is remembered that this is an average difference for three semes- 
ters, is large enough to justify the above statement. 

The achievements of the pupils. Table XXIII presents the 
median achievement ages and quotients for the two groups of schools 
at the beginning and end of the experiment. From these data it 
may be seen that the gain on the part of the pupils of the experi- 
mental schools was three months of achievement age greater than 
that for the other group of schools and that the gain in achievement 
quotient was one point greater. These figures show that for the 
pupils who remained throughout the course of the experiment the 
experimental schools were slightly more efficient in so far as achieve- 
ment was concerned. 


Summary. The evidence afforded by the study of the pupils 
who remained in school during the course of the experiment shows 
that for these pupils the experimental plan of procedure resulted 
in appreciably greater progress according to the ability of the 
children and in slightly greater achievement. The difference in the 
“progress quotients” was four points and that in the achievement 
quotients, one point. Thus the general conclusion to be drawn 
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TABLE XXIII. MEDIAN ACHIEVEMENT AGES AND QUOTIENTS OF 
PUPILS WHO WERE PRESENT THROUGHOUT THE EXPERIMENT 
IN FEBRUARY, 1921 AND MAY, 1922 


1921 Achievement Age Achievement Quotient 
Grade Section DAEs aac pee PREP Bepeamenta! Control 
1921 1922 1921 1922 1921 1922 1921 1922 
IA | Slow sp ye OL ens eee ee 

Average 5-10 9-7 6-6 9-2 88 132 91 108 

Fast 5-6 11-6 < 70 125 

IIB Slow 6-6 6-5 100 100 
Average 6-7 8—t 7-7 7-6 90 106 101 93 

Fast 8-0 9-5 103 108 

IIA Slow 6-7 8-11 90 112 
Average 7-6 9-8 8-1 9-6 93 111 93 105 

Fast 8-1 9-6 91 102 

IIIB Slow 8-2 9-5 109 118 
Average 8-10 | 10-0 9-1 10-8 106 107 105 104 

Fast 8-10 8-11 98 109 

IIIA Slow 8-11 8-8 115 105 
Average 10-1 9-5 9-8 10-0 113 99 115 98. 

Fast 9-10 | 10-6 107 92 

IVB Slow 8-11 94 112 103 
Average 9-11 10+ 9-1 10-11 106 110 108 115 

Fast 10-6 10-2 105 100 

IVA Slow — 9-7 10-7 107 111 
Average 10-11 11-10 | 10-3 12-3 111 bly 102 124 

Fast 10-6 12-10 100 111 

VB Slow 9-7 11-8 107 116 
Average 11-0 12-8 10-7 11-11 110 115 104 114 

Fast 10-5 12-10 98 114 

VA Slow 10-2 12-0 106 117 
Average 11-8 13-8 114 12-1 108 118 107 111 

Fast 11-11 16-10 103 137 

VIB Slo 10-1 12-10 104 124 
Neatige 11-11 14+4 12-1 14-1 106 118 107 120 

Fast 13-10 16-4 112 116 

VIA Sl 11-7 13-2 112 111 
Diecaee 12-6 14-0 12-1 14455 104 114 107 112 

Fast 15-0 14-6 112 110 

IIB Sl 12-5 15-2 108 123 
‘ peu 12-4 13-7 13-11 144 103 117 105 108 

Fast 14-6 15-10 103 118 

IIA Sl 12-6 13-7 110 110 
pe Aeerdes 13-7 16-1 14-7 14-9 103 114 101 113 

Fast 15-6 18-2 102 124 

eas 16-5 eats 125 
Me ee 12-0 17-0 16-5 16-7 100 114 118 120 

Fast 19-8 120 

IIIA Sl eats 14-0 a iets 95 
¥ fence eed 17-10 a ead 1744 dvahane 113 weds 112 
All All 9-10 11-6 10-2 11-7 106 112 104 109 


from this study is the same as that drawn from the study of all 
the pupils, that the experimental plan of organization was some- 
what more efficient than was the traditional plan. 
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CHAPTER VI 


A SPECIAL STUDY OF THE BRIGHTER AND 
DULLER PUPILS 


It is evident that such an experiment as the one described in 
this bulletin might not have the same effect upon the efficiency of 
the instruction of the brighter, the average and the duller pupils. 
In view of this fact a special study was made of the brighter and 
another of the duller pupils in order to discover the effect of the 
experimental plan of organization upon the efficiency of the instruc- 
tion of these two groups. For the purpose of the two studies the 
records of those pupils whose I. Q.’s as found at the first testing 
period were 115 or higher and of those whose I. Q.’s were less 
than 80 were used. The former group included about one-sixth of 
the total number of pupils and the latter group about one-fifth. 
All records not complete for the duration of the experiment were 
rejected so that the number of pupils actually included in these 
studies was reduced to 199 brighter pupils and 514 duller pupils 
from the experimental schools and 396 brighter and 291 duller 
pupils from the control schools. 

The placement of the brighter pupils and their progress 
through the grades. Of the 199 pupils of the experimental schools 
2 percent were placed in the slow sections, 23 percent in the average 
sections and 75 percent in the fast sections at the beginning of the 
experiment. When it closed the respective percents were 1, 51 and 
49. The marked reduction of the number in the fast sections was 
due to the fact that by the close of the experiment these pupils 
had gained one semester or more and in many cases were not quite 
bright enough to attempt to make further gain, at least immediately. 

Table XXIV shows that the number of semesters gained by 
the brighter pupils of the experimental schools varied from two to 
six, and by those of the control schools from one to four. The 
percents of the brighter pupils of the experimental schools making 
Jess than regular, regular and more than regular progress, were 9, 
23, and 68, respectively. In the control schools the corresponding 
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TABLE XXIV. PERCENTS OF THE BRIGHTER AND OF THE DULLER 
PUPILS OF THE TWO GROUPS OF SCHOOLS GAINING OR 
LOSING THE GIVEN NUMBER OF SEMESTERS 
DURING THE EXPERIMENT. 


Average | “Progress 


5) O} 1} 2 | 274) 3 | 374) 4 | 474) 5 | 574] 6 | 7 | 10) 11 Progress} Quotient’’ 


hter Pupils 


i 


xperimental 
Slows ee.. 25) 25) 50 ‘ -63 97 
Average 13 ZU oA re aie as 3.29 92 
Pasty ckesns Stez 17} 9) 19140 |3° 13 2 Boon 106 
AN onal Ae DSi S Ola | Senl2oee |e: 3.80 102 
Controls... 2) 15 72 2.92 77 
Duller Pupils 
Experimental 
Slow2eccenas PDD il St 2] 20) 4 Sih S 2 2.14 99 
Average.... 13| 27} 2 | 43 3) 8113 1* [1* 4 1* |e | 2591 133 
Fast..c. 0. 13] 25 13] 38) 1 3.13 149 
AMUSE. Shes .2| 1] 14] 54] .4] 23) 4) 4 2 ~2*| 2*| .2*| .2*| 2.26 105 
Controls... 1] 8| 36 50 5 55 1* 2.56 119 


*These large amounts of progress were made by foreign-born pupils who, at the beginning of the ex- 
periment, were so handicapped by their inability to use the English language that they made low test 
scores and did poor school work. Many of these pupils were able to skip the work of several semesters as 
soon as the language difficulty was overcome. 


figures were 17, 72 and 11. Table XXIV also shows that the aver- 
age progress of the brighter pupils of the experimental schools was 
.88 of a semester greater than that of the pupils of the control 
schools and that their “progress quotient” was twenty-five points 
greater. ‘These differences show that the experimental schools were 
much more effective in so far as the rate of progress of the brighter 
pupils was concerned. 

The achievements of the brighter pupils. The table just 
below gives the median achievement ages and quotients of the 
brighter pupils of both groups of schools in February, 1921, and 
May, 1922. 


Experimental Control 
1921 1922 Gain 1921 1922. Gain 
Achievement Age 11-4 12-11 19 11-2 12-7 17 
Achievement Quotient 103 112 9 98 104 6 


From these data it is evident that the more rapid progress of the 
pupils of the experimental schools did not result in a lessening of 
their relative achievement but was accompanied by a small gain. 
This gain in relative achievement amounted to two months in terms 
of achievement age or three points in terms of achievement quotient. 
Thus considering progress and achievement together, it may be said 
that for the brighter pupils the experimental plan of organization 
resulted in a marked increase of efficiency. 
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The placement of the duller pupils and their progress 
through the grades. Of the 514 duller pupils from the experi- 
mental schools, 86 percent were placed in the slow sections, 12 
percent in the average and 2 percent in the fast sections at the be- 
ginning of the experiment. At the close of the experiment the re- 
spective percents were 85, 13 and 2. Thus it is apparent that there 
was practically no change in the number of pupils in each of the 
three sectional groups. 

Table XXIV shows that the number of the duller pupils making 
more than normal progress was not very large in either group of 
schools. Slightly over one-half of the duller pupils of the experi- 
mental schools made regular progress in the slow sections, which 
resulted in their covering two semesters’ work during the three 
semesters of the experiment. Slightly less than one-fourth of them 
made three semesters’ progress by maintaining membership in the 
average sections. Ten percent managed to make more than normal 
progress, while 15 percent made less than two semesters. In 
the control schools 50 percent made normal progress, 45 percent 
less and 6 percent more. The average progress was three-tenths of 
a semester greater for the pupils of the control schools and the 
“progress quotient” fourteen points greater. 

Analyzing the data presented above it is apparent that more 
of the duller pupils were failed in the control schools than in the 
experimental schools. Since, however, pupils were able to advance 
in the slow sections without failure while covering less than the 
normal amount of work the average progress was less in the 
experimental schools. As was true in the case of the brighter 
pupils more of the pupils from the experimental schools made 
extra progress, 

The achievements of the duller pupils. The table just be- 
low gives the median achievement ages and quotients of the duller 
pupils of both groups of schools in February, 1921, and May, 1922. 


Experimental Control 
1921 1922 Gain 1921 1922 Gain 
Achievement Age 8-10 10-6 20 9-3 10-9 18 
Achievement Quotient 112 114 2 115 114 -1 


These data show that the gain made by the duller pupils of the 
experimental schools was two months of achievement age greater 
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than that made by those of the control schools and that their gain 
in achievement quotient was three points greater. Therefore it can 
be said that in so far as achievement was concerned the experi- 
mental plan of procedure was slightly more efficient for the duller 
pupils than the traditional plan used in the control schools. 

Summary. A special study of the brighter and duller pupils 

who were in school throughout the experiment yields the following 
results and conclusions: 

1. The brighter pupils of the experimental schools had a 
“progress quotient” twenty-five points greater than did those 
of the control schools. 

2. The relative gain of the brighter pupils of the experimental 
schools in median achievement quotient was three points. 

3. The “progress quotient” of the duller pupils of the experi- 
mental schools was fourteen points less than that of the duller 
pupils of the control schools. 

4. The duller pupils of the experimental schools made a rela- 
tive gain of three points in their median achievement quo- 
tient. 

A fair statement of the conclusions to be drawn would seem to be 
that the experimental plan of organization was considerably more 
efficient than the traditional plan in so far as it concerned the 
brighter pupils, but that in the case of the duller pupils it was 
somewhat less efficient. 
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CHAPTER VII 


RESULTS AND CONCLUSIONS 


A brief statement of the results of this experiment. The 
results actually obtained in this experiment may be listed as follows: 


I. At the beginning of the experiment the placement of the 
pupils involved a relative loss in placement of .05 semester 
on the part of the experimental schools. This and the other 
amounts of progress are computed relative to the capacity 
of the pupils. 

II. The main study, which included all the pupils of the two 
groups of schools, showed that: 

1. The average progress was .06 semester larger in the 
experimental schools than in the control schools. 

2. There was a relative gain for the experimental schools of 
about one point per semester in the, achievement quo- 
tient as measured by the arithmetic and reading tests. 

3. The achievement quotient derived from the Omnibus Test 
was thirteen points less for the experimental schools. 


III. A special study of the pupils who remained in school 
throughout the experiment gave the following results: 
1. The average progress for the experimental schools was 
.04 semester greater than that for the other group. 
2. There was a relative gain for the experimental schools 
of one point in the achievement quotient. 
IV. A special study of the brighter pupils revealed the ealowe 
ing facts: 
1. Those of the experimental schools progressed at a rate 
.25 semester greater than did those of the control schools. 
2. The relative gain in the achievement quotient on the part 
of the pupils of the experimental schools was three 
points. 
V. A special study of the duller pupils gave the following re- 
sults: 
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1. Those of the experimental schools made, on the average, 
.14 semester less progress per semester than did those of 
the other group of schools. 

2. There was a relative gain of three points in the median 
achievement quotient for the experimental schools. 

It seems fair to summarize these results by saying that for 
pupils of all degrees of intelligence combined the experimental plan 
of organization was more efficient as regards progress and about 
the same as regards achievement, as compared with the traditional 
plan. The difference in progress was considerably more than enough 
to balance the relative loss caused by the placement of the pupils 
at the beginning of the experiment. 

Conclusions to be drawn from these results and their ap- 
plication to school systems in general. The comparisons that 
were made between the schools taking part in this experiment and 
certain other city school systems seem to show that the results 
obtained in this experiment and the conclusions based thereon are 
fairly applicable to school systems in general. Assuming that this 
conclusion is warranted, the question remains as to whether or not 
the classification of pupils along lines similar to those followed in 
this experiment should be recommended to school administrators 
as a practical method of procedure. In considering this question 
it should be recognized that the public school superintendent or 
supervisor can ordinarily exercise a somewhat higher degree of 
supervision over the schools under his control than could the 
writer over the schools participating in this experiment. Therefore, 
it should be possible to secure somewhat more favorable conditions 
for carrying out the experimental plan of organization than were 
possible in this experiment. 

In the second place, the question arises as to how large a gain in 
output, that is to say in progress and achievement, is required to 
justify a certain amount of additional investment. In this experi- 
ment the cost in both money and time was considerably larger per 
pupil than would be necessary in the usual public school situation. 
Ordinarily pupils would not need to be tested so often nor would 
it be necessary to use tests of achievement. Furthermore, there 
were many tabulations and computations made in this project that 
would not be necessary in the ordinary school situation. The cost 
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of group intelligence tests is only a few cents per pupil, in some 
cases being as low as one and one-half cents and in few more than 
ten cents. If the teachers scored the papers there would be no 
extra expense involved therein. Thus the cost of the tests and a 
rather small amount of clerk hire would be all the unusual outlay 
required to make use of group intelligence tests for purposes of 
placing pupils. Certain plans of doing this have involved a de- 
crease in the average number of pupils per teacher or per room or 
some other element of additional investment. In this experiment 
there was no such expenditure, nor need there be in the usual 
situation. The desirability of reducing class size, whether in this 
or some other type of organization, is a separate problem. There- 
fore the total cost of the type of organization used in the experi- 
mental schools amounts to only a fraction of one percent of the 
total expenditure per pupil. As the gain in progress on the part of 
the experimental schools amounted to several percent of the total 
progress and as there was no loss in achievement, and, furthermore, 
as it is probable that under ordinary conditions the gain would be 
greater than it was in this project it would seem that an additional 
investment of a fraction of one percent would be entirely justifiable. 

There remains, however, another point that must be consid- 
ered in this connection. In Chapter I, output was defined as being 
composed of progress and achievement. There are undoubtedly 
other less tangible factors that constitute a part, and a rather 
important part, of the output of a school system. Such outcomes 
as industry, good citizenship, intellectual honesty, social develop- 
ment, etc., were either not measured in this experiment or measured 
so indirectly that no assumptions can be made concerning their 
presence and amount. This fact does not invalidate the conclu- 
sions reached, but merely signifies that these other outcomes of 
instruction must be considered in their interpretation. The fact 
that we cannot measure the total output should not bar us from 
measuring that which can be measured nor from proceeding ac- 
cording to what our measurements reveal until more complete 
measurements are possible. 

It must also be remembered, as was stated in Chapter I, that 
there were really two problems involved in this experiment. It is pos- 
sible that a portion or all of the results obtained in this experiment 
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might be secured in a somewhat similar experiment in which the 
pupils were classified according to teachers’ judgments. Especially 
might this occur if the teachers participating were well-trained and 
experienced, and perhaps had given special study to the problem 
of classifying pupils according to their capacities. There were sev- 
eral reasons why the pupils in the control schools were not so 
classified, the chief one being that it was impracticable in the given 
situation. It may be suggested that since fast, average and slow 
sections were not formed in the control schools, they should not 
have been formed in the experimental schools. As was stated in 
Chapter I, the use of intelligence tests for the purpose of placing 
pupils implies that the pupils be placed according to their capaci- 
ties and that it would not have been possible to arrange an experi- 
ment that would show the value of intelligence tests for the purpose 
mentioned unless such sections had been formed. Also the writer 
does not believe that the classification of the pupils of the experi- 
mental schools according to the teachers’ judgments would have 
yielded as favorable results as did their classification according to 
the principles enumerated in Chapter I. This belief is based upon 
a study of the accounts of various experiments and of the 
teachers’ estimates of capacity and the average school marks actually 
given in this experiment. These disagreed with the results of the 
intelligence tests in many cases and in most of these the latter ap- 
peared to furnish a more reliable means of predicting future 
progress and achievement than did the former. 

In considering the conclusions reached from this study it should 
be borne in mind that the total time included was only three 
semesters. It is probable that if the experiment had continued 
for a longer time, say for eight or ten years, certain effects would 
have been noted that did not appear during the three semesters or 
effects that were present might have appeared in much more pro- 
nounced fashion. In general it seemed that as the experiment 
progressed from semester to semester the plan of organization 
being tried out gave better results. If the teachers had had several 
years’ experience with such a plan the results might have been 
still more favorable. The plan was new to the teachers and hence 
they probably could not do their best work at first. On the other 
hand, it is possible that a division of the pupils into three groups 
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might tend to make the teachers feel less responsible for the 
achievements of the pupils, especially those of the duller ones. 
They might more or less unconsciously come to feel that the pupils 
placed in the slow sections could not be expected to do a very high 
quality of work and that therefore they were not worth much at- . 
tention and effort. Such a result would, of course, be decidedly 
undesirable. 

Considering the facts and possibilities mentioned above it is 
the opinion of the writer that the use of intelligence tests as the 
chief basis of classifying pupils increases the output of the school 
sufficiently to justify the additional expense involved. It is not, 
however, a panacea for all inefficient schools nor a method of organ- 
ization that should be rushed into by every school administrator 
before he has made a careful study of its installation and operation. 
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APPENDIX A 


A COMPARISON OF THE PUPILS ENTERING AND LEAV- 
ING SCHOOL DURING THE EXPERIMENT WITH THE 
TOTAL NUMBER OF PUPILS 


Necessity for this comparison. Inasmuch as the shifting of 
membership within both groups of schools was so large, it seemed 
wise to take definite account of its effect upon the results and con- 
clusions reached. In Chapters III and IV, where these results and 
conclusions are given, this effect has been considered. It was more 
or less probable that the number or mental capacities of the pupils 
eliminated from the experimental schools might be considerably 
influenced by the conditions of the experiment. For example, the 
recognition of the ability of the brighter pupils might tend to hold 
a larger percent of them in school and the placing of the duller pupils 
in slow sections might cause more of them to leave school than 
would normally be the case. This would, of course, materially 
raise the general mental level of the pupil material. On the other 
hand, it is possible that by placing many duller pupils, who would 
otherwise be failed, in the slow sections more of them would be 
held in school and that by allowing the brighter pupils to progress 
more rapidly they would be encouraged to leave school sooner 
than would otherwise be the case. Such results as these would 
lower the general mental level. Or perhaps some other combina- 
tion of the four possible results just mentioned took place, so that 
more pupils of all degrees of ability were held in school, or more 
eliminated. Or again, other effects than those mentioned might 
have resulted. In regard to the new entrants, a priori reasoning 
would lead to the conclusion that they would have no effect upon 
the outcome of the experiment, since its operation would not in 
any way cause them to enter or not to enter school. However, it 
was thought best to make a study of them as well as one of the 
eliminees. 

The effect of the pupils entering and leaving school dur- 
ing the experiment upon the total school population. It was 
found that during each of the three semesters of the experiment 
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the percent of pupils eliminated from the experimental schools 
was much greater than that from the control schools, the averages 
being about 12 and 7 percent, respectively. It might seem, there- 
fore, that the experimental plan of organization resulted in increas- 
ing the amount of elimination. The writer does not believe, how- 
ever, that this was the case. If it had been, the elimination rate 
for the pupils in the different sectional groups probably would have 
varied considerably. A study of this phase of the question shows 
that for each of the semesters the percents of all the pupils belong- 


ing to the fast, average and slow sections that were eliminated _ 


were practically the same. To word it differently, the percent of 
all pupils eliminated that had been in the fast sections was almost 
exactly the same as the percent of all pupils placed therein. A 
similar condition held for the other sections. Furthermore, the 
principals of the experimental schools stated that the elimination 
was no greater than was usual. 

Table XXV shows the effects of the entrance and the elimina- 
tion of pupils upon the total school population. It is to be read as fol- 
lows, taking the first double column of the row of entries following 
“Med. Chron. Age” as an example: the elimination of pupils 
during the second semester of 1920-21 caused a decrease of one- 
tenth of a year more in the median chronological age of the pupils 
of the experimental schools than in that of the control schools. 
The entrance of new pupils during this time had no effect. 


TABLE XXV. THE EFFECTS OF THE ENTRANCE AND ELIMINATION 
OF PUPILS UPON THE TOTAL PUPIL POPULATION 


Second First Second 
Semester ee Semester Semester 
of 1920-21 of 1921-22 of 1921-22 
Elim. |NewE.] Elim. |NewE.| Elim. |NewE.| Elim. |NewE. 

Med. Chron. Age........|| —.1 —.2 —.1 | —1 | —2 
Percent Accelerated...... —1. —1l. 41. ork 
Percent Retarded........ +1. +1. +] 
Aver.Retardation....... 2203 14.08 nen 04 =.02 e402) 04 
Aver brOoresSecrirraceien —.01 —.01 —.01 
ProgaQuotient.: aa... —1. 
Median M. A..:.....-... —.l —.2 | —.1 
Metiand)O.c.. «pues eal, 
Medan AyAn ee Sere a 
Median A.Q........... esi , 


—_—— 
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In making use of the data in this table it must be borne in 
mind that all of the eliminated pupils were not included in the 
tabulations from which the data were derived. In a rather large 
number of cases the individual record cards of pupils who had left 
school were not returned to the writer along with the cards of those 
still in school. Practically all of these cases were in the control 
schools. In other cases the pupils were absent at the time of test- 
ing but did not actually withdraw from school until later, not re- 
turning to be tested in the meantime, so that another possible 
source of discrepancy was introduced. In view of these facts it 
was not certain that the effects listed in the table were all of the 
effects or were the true effects produced upon the pupil material 
by the pupils who left during the experiment. In the case of the 
new entrants there were no such opportunities for records to be lost 
unless the pupils concerned not only entered but left during the 
same semester, in which case they would not have been included 
in the tabulation. 

The effect of the differences between the new entrants and 
eliminees and the total pupil population in so far as they relate 
to progress were considered in Chapter III. On the whole these 
effects were comparatively small. Those having to do with achieve- 
ment were not used in Chapter IV or elsewhere. ‘The reason for 
this was that all the tabulations in that chapter were made for the 
pupils who were present throughout the semester and hence did 
not need to be included for the pupils entering or leaving during 
the given semester. They are merely presented here as a matter 


of interest. 
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APPENDIX B 


THE RELIABILITY AND CORRELATION OF THE TESTS 
USED IN THIS EXPERIMENT 


In considering the results of such an experiment as the one 
described in the body of this report the question of the reliability 
of the tests used at once arises. The writer will not go into the 
matter in a detailed way but will merely present such coefficients 
of correlation and other measures of the reliability of the tests as 
were obtained and comment briefly thereon. No attempt was 
made to compute all the possible correlations between the tests 
used, 


Constant and variable errors. Before proceeding to give the 
data referred to in the preceding paragraph, a brief discussion of 
the errors present in test scores seems appropriate. These errors 
may be classified as constant and variable. 

Constant errors are those which are the same or approximately 
so for the group being tested. If, for example, the person giving 
the test allows less time than the directions call for a constant 
error is introduced, the effect of which is to lower the scores of all 
pupils taking the test. On the other hand, if too much time is 
allowed the scores are too large. Probably the most frequent 
constant errors are those due to what is often called “practice 
effect.” If a duplicate form of a test is given the scores made 
thereon are ordinarily somewhat higher than those made at the 
first trial. Such constant errors were, of course, present in this 
experiment but as they were equally present for the two groups of 
schools it was not necessary to make any allowance for them. 

Variable errors are those which differ for the different indi- 
viduals taking the test. ‘They are due to a number of causes. On 
any given day certain pupils are below par physically or mentally 
and therefore are likely to make a lower score than they would 
ordinarily. Such happenings as the breaking of a pencil point, the 
dropping of a test paper upon the floor or some occurrence dis- 
tracting an individual’s attention cause variable errors. All of these 
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mentioned so far result in lower scores. On the other hand, it may 
be that the particular form of a test used contains items which 
happen to be well known by a few members of the group taking 
the test. Such a condition results in an increased score. Scores 
may also be increased if a pupil turns the page and starts before 
the signal is given, if he does not know the correct answer but gets 
it by looking at someone else’s paper, and by various other causes. 
It is usually impossible to determine the variable errors present 
in the scores of the individual pupils, although this can sometimes 
be done by a more or less detailed investigation. The effect of 
these errors is that the scores of many of the pupils are slightly 
too large or too small and those of a few are very much in error. 
On the other hand, the variable errors cause very little or no change 
in the average. In the long run they are as often positive as nega- 
tive and therefore offset each other in the computation of averages. 

The reliability of the Pressey Primer and the Illinois Gen- 
eral Intelligence Seales. As the two scales named were the only 
ones used more than once in this experiment, they are the only 
ones for which the reliability can be calculated. The coefficients 
of correlation or of reliability,t the indices of reliability,’ the prob- 
able errors of measurement,® and the percents these probable errors 
were of the respective medians were calculated.* Throughout the 
discussion of these measures of reliability it should be remembered 
that they were all computed from the use of tests at intervals of 
about six months and one year and therefore should not be ex- 
pected to show as high a degree of reliability as if the time intervals 
had been shorter. In most studies of the reliability of tests the 


1The coefficient of correlation between repetitions or duplicate forms of the same 
test is called the coefficient of reliability. 

2The index of reliability is the square root of the coefficient of reliability. It 
measures the correlation between the score on one trial of a test and the true score. 
This true score is the average of the scores made upon an infinite number of trials of 
the test after these have been corrected for any constant errors. 

The term “probable error of measurement” bears the same relation to the index 
of reliability that the probable error of estimate bears to the coefficient of reliability. 
It is a measure of the variable error by which a pupil’s score upon one trial of a test 
deviates from his true score. The formula is 6745¢V 1—r. For o the average of 
the standard deviations obtained from the scores made on each of two trials is used. 

4The complete tables are to be found in the dissertation by the same title and 


author. 
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interval between the periods at which the tests were given has not 
exceeded a few days. 

Table XXVI, Part A, shows that there was in general little 
difference in degree of reliability between the Pressey Primer and 
the Illinois General Intelligence Scale, that of the former being 
slightly higher. The average coefficient of reliability was in each 
case about four-tenths for the single half-grade groups and not far 
from seven-tenths for all grades combined. The average indices 
of reliability were somewhat greater than six-tenths and eight- 
tenths, respectively. The probable error of measurement averaged 
about nine points, or 15 percent of the median, in both cases. 
In the case of the Illinois Scale this amounts to almost one year 
of mental age, whereas in that of the Pressey it is somewhat less. 


TABLE XXVI. DATA CONCERNING THE INTELLIGENCE TESTS USED 
IN THIS PROJECE 


A. Reliability 


Coefficient of] Index of E ey P.E. Meas. 
Reliability | Reliability |""\yyient | Median 
Pressey (Nov., 1920 and May, 1921) 
Grade‘Averageno.. 20: 46+.02 sOvj=2 02 8 .16 
Grades Combined........ S65==301 pola Ol 9 115 
Illinois (Form 1 in Nov., 1920 and Form 2 in May, 1921) 
Grade Average. . Fall) oSsssWe! 62 ==503 9 a6 
Grades Combined........ 169-0 RCSe =e Ol 9 sil 
(Form 2 in Oe 1921 and Form 1 in Dec., 1921) 
Grade Average.. onl ona Oe a@y/SS Oy 8 .14 
Grades Combined........ .73+.01 | .85+.01 9 13 
(Form 1 in Nov., 1920 and in Dec., 1921) 
Grade Average. . all) othe Oe 35.03 9 .14 
Grades Combined........ .62+.01 Vise! 10 a5 
B. Correlations Between the Different Tests Used. 
Grade Grades 
Average Combined 
Pressey and Dearborn (Used at Same Time) BES Oia -29se Ox /S==. 01 
Illinois and National ( “ ) Poseret Ree alee OSSD Shee sO 
Pressey and Myers ( “ one semester apart) Rea nche Oe e OAS bare GOS} Pee, (Ol 
Kingsbury and Myers ( “ “ ss ease eee .47+.01 Veen 
Pressey and Illinois (“ “ ss a Ree re ts |v sees OVS (08 Pee Ae Reh: 
Dearbornand Illinois (“ “ ad A a peisey (0s La ao 
Pressey-Dearborn and Illinois (Used one semester apart) See SOEETOS pee td 
Dearborn and Myers (Used one year apart)........... POO Stem Oa Rowan 
PresseyaanduVl vers san (Gn as ES ees eh od . 32.04 .46+.01 


*In these cases the correlations from only one grade are available. 
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In other words, the mental ages derived from a single application 
of the tests would be within that distance of the true mental ages 
in only about 50 percent of the cases. 

Certain data as to the reliability of these two scales have been 
given by their authors. The administration of the Pressey scale 
to 365 first, second and third grade pupils gave an average coefli- 
cient of reliability of .92 between the first and second halves of 
the scale. With two other groups of pupils numbering slightly 
over 100 each, coefficients of .89 and .92 were obtained.® The 
probable error of measurement was found to be between two and 
three points on the scale. These coefficients are naturally much 
higher and the probable errors much less than those obtained in 
this experiment because of the difference in the intervals between 
testing. The coefficients of reliability for Forms 1 and 2 of the 
Illinois scale are not quite as high as those between the two halves 
of the Pressey scale. Results based upon about 1000 children gave 
an average coefficient of .83 for grades III to VIII and one of 
.92 for the grades combined.’ The probable error of measurement 
was between five and six points on the scale. These figures also 
show a considerably higher degree of reliability than do those obtained 
by testing at intervals of six months and one year. Inasmuch as the 
scale of the Illinois is finer than that of the Pressey, the probable 
errors are not far from the same when converted into mental ages. 

The coefficients of reliability that are given for two or three 
other group intelligence tests run from about .75 up.2 They tend 


5Pressey, L.W. ‘‘A Group Scale of Intelligence for Use in the First Three Grades.” 
Journal of Educational Psychology, 10, 297-308, September, 1919. 

6Pressey, L.W. “A Group Scale of Intelligence for Use in the First Three Grades.” 
Journal of Educational Research, 1, 285-94, April, 1920. 

7Monroe, W. S. “The Illinois Examination.” University of Illinois Bulletin, 
Vol. 19, No. 9, Bureau of Educational Research Bulletin No. 6. Urbana: University 
of Illinois, 1921. p. 47-49. 

Monroe, W. S. and Buckingham, B. R. “The Illinois Examination I and II. 
Teacher’s Handbook.” Bloomington: Public School Publishing Company, 1920, 


pols . 
i 8Colvin, S. S. ‘Educational Tests at Brown University.” School and Society, 


LOM eulyass 1919: 
ee S.S. “Some Recent Results Obtained from the Otis Group Intelligence 


Scale.” Journal of Educational Research, 3, 1-12, January, 1921. 
OtiseAlns amc At Absolute Point Scale for the Group Measurement of Intel- 
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to average about .80. Therefore, if these few are typical of similar 
tests in general, it would seem that the Pressey and Illinois scales 
are more reliable than are most group intelligence tests. From 
such a comparative standpoint coefficients of reliability around .90 
and probable errors of measurement of two and five points may 
be said to be rather satisfactory. ‘The differences between these 
figures and those obtained in this project may be largely, if not 
entirely, attributed to the difference in the time elapsing between 
the giving of the tests. 


The correlations between the different group intelligence 
tests used in this experiment. Part B of Table XXVI presents 
the correlations obtained between the different tests used. It will 
be seen that the correlation between the Pressey scale and the 
Dearborn tests and that between the Illinois scale and the National 
tests are fairly high. An average correlation of about .60 when 
pupils are taken by half-grade groups and of about .80 for all 
grades combined is higher than is usually found between group 
intelligence tests. 

The correlations between the results of the tests used at inter- 
vals of six months and one year are considerably lower. This 
would, of course, be expected as they take account not only of 
the differences between the tests but also of changes in the true 
mental abilities of the pupils during the period elapsing between 
the giving of the tests and of differences in the general conditions 
of testing at the two times. On the whole, these correlations do 
not compare unfavorably with similar correlations obtained else- 
where. 

The writer collected data concerning the correlations found 
between different intelligence tests in some fifty cases. In practi- 
cally all of these the different tests were given within a compara- 
tivly short time of each other, usually within the same week. The 
unweighted average of the coefficients of correlation was .62, which 
is only slightly higher than the average correlation by half-grade 
groups given in Part B of Table XXVI and much lower than that 


ligence.” Journal of Educational Psychology, 9, 333-47, and 237-61 May, 1918, and 
June, 1918. 


Snarr, O. W. “Reliability of General Intelligence Tests in Classifying High 
School Pupils.” Unpublished Thesis, University of Chicago, Chicago, June, 1919. 
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obtained for the grades combined. This is true although in a 
number of cases the coefficients were based upon several grades 
combined. Only about a dozen of the fifty are as high or higher 
than those of .78 and .81 which were obtained in this experiment 
when the grades were combined. In only one case was there a 
coefficient found higher than .90. Thus it may be said that the 
correlation between the Pressey scale and the Dearborn tests and 
that between the Illinois scale and the National tests were rather 
satisfactory as compared with similar correlations obtained in other 
experiments. 

Although the coefficients given in Part B of Table XXVI were 
obtained from testing at intervals of one and two semesters, yet 
some of them compare favorably with a number of those given 
in the accounts of other experiments. When several half-grade 
groups were combined the coefficients averaged about .46. 

The degree of reliability of single test scores was of concern 
in placing the individual pupils, but in measuring the results of 
the experiment this was not a matter of importance. The average 
used in most cases was the median, and for this the probable error 
is 1.25 (approx.) times the probable error of the distribution divided 
by the square root of the number of cases.° As the number of 
pupils included in this experiment was so large, the distribution 
would have had to be very scattering and the probable errors very 
large to cause the medians to be unreliable to any considerable 
degree. The distribution of the 3615 November, 1920, scores upon 
the Illinois scale, for example, had a probable error of 41 points, 
or 4.1 years of mental age. The probable error of the median 
was therefore about .85 point or one month. 


*Yule,G.U. “An Introduction to the Theory of Statistics,” London: Charles 
Griffin and Company, 1919, p. 338. 
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APPENDIX C 


THE OMNIBUS TEST 


As was mentioned in Chapter IV, a test called the Omnibus 
Test was devised by the writer to measure certain achievements 
of the pupils in the upper grades that were not covered by the 
reading and arithmetic tests used. This test was of the true-false 
type. It included seventy-five statements of which approximately 
half were correct and half incorrect. The following gives the first 
ten statements of the test: 


1. Russia produces a large amount of wheat... 
The ancient Greeks were famous for their art.... 
Charcoal is made from wood 
4.6 -1s sLOO Stimesu 4 Oe ee ee ee 
A paragraph should be indented 
Italy) raisesvaereat'dealtot faxee = ae 
The Roman Empire was not as powerful 
as Greece. cee A ie See eee 
8. Digestion begins in the mouth 
D2P41 1000.) sat Le ee eee 
10. A compound sentence has at least two in- 

dependent clauses 


IDARWN 


Every fifth statement had to do with the same subject, the five 
subjects included being geography, history, elementary science, 
arithmetic and grammar. The fifteen statements dealing with each 
subject were divided approximately equally between the six 
semesters of work covered and were in all cases based upon material 
mentioned in the outline of the Chicago course of study. The seven- 
ty-five statements were preceded by explicit directions and prelimi- 
nary practise statements. The pupils were instructed to place a plus 
mark after those statements that were correct and a minus sign 


after those that were incorrect. A time limit of four minutes was 
placed upon the test. 
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a River; State Water Survey; State Geological Survey; U. S. Bureau of Mines 
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Bamesberger, Velda C. Standard Requirements for 
Memorizing Literary Material 


Holley, Charles E. Mental Tests for nea Use. | 
(Out of. print) 22 -i ee Le icreteccatenesstineaseaceen antares 


Monroe, Walter S. Report of Division of Educational : 
Tests for 1919-20 


Monroe, Walter S. The Illinois Examination 


Monroe, Walter S. Types of Learning Required of — 


Pupils in the Seventh and Eighth Grades and in 


the® High. Schook:..:i5,i-ssesgeste so aces nleara aa ane 
Monroe, Walter S, A Critical Study of Certain Silent os 
Reading ‘Tests 


Monroe, Walter 8, Written Examinations and Their 


Improvement 


10. Bureau of Educational Research. Relation of Size 


veh te 


of Class to School Efficiency 


Monroe Walter S. Relation of Sectioning a Class to — 
the Effectiveness of Instruction 


12, Odell, Charles W. The Use of Intelligence Tests as a 


Basis of School Organization and Instruction 


